# US 8,751,550 B2 · Freeform mathematical computations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,751,550 B2
- Document ID: US8751550B2
- Status: Granted
- Kind: B2
- Application number: 12/797,492
- Filed: 2010-06-09
- Published: 2011-12-15
- Granted: 2014-06-10
- Earliest claimed: 2010-06-09
- Assignees: Microsoft Corporation
- Applicants: Magdalena Vukosavljevic; Ivan Stojiljkovic
- Inventors: Magdalena Vukosavljevic; Ivan Stojiljkovic
- Web page: https://patentgrep.com/patent/US8751550B2

## CPC

- G06V 30/36: {Matching; Classification}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 15/0225: {User interface arrangements, e.g. keyboard, display; Interfaces to other computer systems}
- G06F 15/025: {adapted to a specific application}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Freeform mathematical computations are described. In implementations, an input is recognized as a freeform selection of an area of a user interface output by a computing device. Text is identified that is associated with the area defined by the freeform selection and that includes one or more numbers. A mathematical computation is performed that involves the one or more numbers.

## Claims

### Claim 1

A method comprising:
recognizing an input as a freeform selection of an area of a user interface output by a computing device, the area including at least a plurality of numbers that are to be the subject of a mathematical computation;
converting digital ink strokes associated with the area into text by the computing device;
displaying the text within the user interface of the computing device adjacent at least a plurality of numbers in said area to verify that the converting was performed successfully; and
performing a mathematical computation that involves the one or more numbers, and displaying a result of the mathematical computation to appear in freeform to mimic handwriting of the digital ink strokes.

### Claim 2 (depends on 1)

A method as described in claim 1, wherein the user interface of the displaying is configured to receive one or more inputs to correct the text.

### Claim 3 (depends on 1)

A method as described in claim 1, wherein the user interface of the displaying is configured to verify the mathematical computation that is to be performed, the mathematical computation identified from one or more of the digital ink strokes.

### Claim 4 (depends on 1)

A method as described in claim 1, wherein the user interface of the displaying includes a portion that is selectable to initiate the performing of the mathematical computation.

### Claim 5

One or more computer-readable storage memory comprising instructions that, responsive to execution on a computing device, cause the computing device to perform operations comprising:
recognizing an input as a freeform selection that at least partially encloses an area of a user interface output by the computing device;
converting one or more handwritten digital ink strokes within the area into text by the computing device, the one or more digital ink strokes representing one or more parameters of a mathematical computation;
identifying the mathematical computation to be performed from at least one of the digital ink strokes representing the one or more parameters included in the area;
detecting, from the one or more parameters, corresponding values to the one or more parameters and a blank parameter that is to be computed; and
performing the identified mathematical computation using the corresponding values of the one or more parameters to compute the blank parameter, and displaying a result of the mathematical computation to appear in freeform to mimic handwriting of the digital ink strokes.

### Claim 6 (depends on 5)

One or more computer-readable storage memory as described in claim 5, wherein the handwritten digital ink strokes are input using a stylus.

### Claim 7 (depends on 5)

One or more computer-readable storage memory as described in claim 5, wherein the freeform selection is handwritten.

### Claim 8 (depends on 5)

One or more computer-readable storage memory as described in claim 5, wherein the user interface output by the computing device is configured to receive one or more inputs to correct the text.

### Claim 9 (depends on 5)

One or more computer-readable storage memory as described in claim 5, wherein the freeform selection that at least partially encloses the area of the user interface approximates a circle.

### Claim 10 (depends on 5)

One or more computer-readable storage memory as described in claim 5, wherein the handwritten digital ink strokes are input using a finger of a user's hand.

### Claim 11

One or more computer-readable storage memory comprising instructions that, responsive to execution on a computing device, cause the computing device to perform operations comprising:
recognizing an input as a freeform selection of an area of a user interface output by the computing device, the area including at least a plurality of numbers that are to be the subject of a mathematical computation;
converting digital ink strokes associated with the area into text by the computing device;
displaying the text within the user interface of the computing device adjacent at least a plurality of numbers in said area to verify that the converting was performed successfully; and
performing a mathematical computation that involves the one or more numbers, and displaying a result of the mathematical computation to appear in freeform to mimic handwriting of the digital ink strokes.

### Claim 12 (depends on 11)

One or more computer-readable storage memory as described in claim 11, wherein the user interface of the displaying is configured to receive one or more inputs to correct the text.

### Claim 13 (depends on 11)

One or more computer-readable storage memory as described in claim 11, wherein the user interface of the displaying is configured to verify the mathematical computation that is to be performed, the mathematical computation identified from one or more of the digital ink strokes.

### Claim 14 (depends on 11)

One or more computer-readable storage memory as described in claim 11, wherein the user interface of the displaying includes a portion that is selectable to initiate the performing of the mathematical computation.

### Claim 15

A method comprising:
recognizing an input as a freeform selection that at least partially encloses an area of a user interface output by a computing device;
converting one or more handwritten digital ink strokes within the area into text by the computing device, the one or more digital ink strokes representing one or more parameters of a mathematical computation;
identifying the mathematical computation to be performed from at least one of the digital ink strokes representing the one or more parameters included in the area;
detecting, from the one or more parameters corresponding values to the one or more parameters and a blank parameter that is to be computed; and
performing the identified mathematical computation using the corresponding values of the one or more parameters to compute the blank parameter, and displaying a result of the mathematical computation to appear in freeform to mimic handwriting of the digital ink strokes.

### Claim 16 (depends on 15)

A method as described in claim 15, wherein the handwritten digital ink strokes are input using a stylus.

### Claim 17 (depends on 15)

A method as described in claim 15, wherein the freeform selection is handwritten.

### Claim 18 (depends on 15)

One or more computer-readable storage memory as described in claim 15, wherein the user interface output by the computing device is configured to receive one or more inputs to correct the text.

### Claim 19 (depends on 15)

One or more computer-readable storage memory as described in claim 15, wherein the freeform selection that at least partially encloses the area of the user interface approximates a circle.

### Claim 20 (depends on 15)

One or more computer-readable storage memory as described in claim 15, wherein the handwritten digital ink strokes are input using a finger of a user's hand.
