# US 2008/0260240 A1 · User interface for inputting two-dimensional structure for recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0260240 A1
- Document ID: US20080260240A1
- Status: Published application
- Kind: A1
- Application number: 11/788,180
- Filed: 2007-04-19
- Published: 2008-10-23
- Earliest claimed: 2007-04-19
- Assignees: Microsoft Corporation
- Inventors: Milan Vukosavljevic; Bodin Dresevic; Dejan Ivkovic; Goran Predovic
- Web page: https://patentgrep.com/patent/US20080260240A1

## CPC

- G06V 30/387: {using human interaction, e.g. selection of the best displayed recognition candidate}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In embodiments consistent with the subject matter of this disclosure, a user may input one or more strokes as digital ink to a processing device. The processing device may produce and present a recognition result, which may include a misrecognized portion. A user may indicate a desire to correct the misrecognized portion and may further select one or more strokes of the misrecognized portion. The processing device may then present the one or more recognition alternates corresponding to the selected one or more strokes of the misrecognized portion. In some embodiments, the processing device may permit a user to rewrite the selected one or more strokes of the misrecognized portion with newly entered digital ink. Features, such as, rewriting and correction of the input digital ink may be discoverable in some embodiments.

## Claims

### Claim 1

A machine-implemented method of correcting recognition errors with respect to digital ink input, the machine-implemented method comprising:
recognizing the digital ink input, including a plurality of strokes, and presenting a recognition result;
receiving a first selection indicating at least one of the plurality of strokes corresponding to a misrecognized portion of the recognition result;
presenting, as a result of the receiving of the first selection, a first level of a multilevel menu, the first level of the multilevel menu including at least one first alternate corresponding to the at least one indicated plurality of strokes;
presenting a second level of a multilevel menu when a second selection, indicating one of the at least one first alternate, is received, the second level of the multiple level menu including at least one second alternate having a same structure of the indicated one of the at least one first alternate; and
attempting to correct the presented recognition result when a third selection, indicating one of the at least one second alternate, is received.

### Claim 2 (depends on 1)

The machine-implemented method of claim 1, wherein the first level of the multilevel menu and the second level of the multilevel menu are drop-down menus.

### Claim 3 (depends on 1)

The machine-implemented method of claim 1, wherein attempting to correct the presented recognition result when a third selection, indicating one of the at least one second alternate, is received, further comprises:
re-recognizing at least a portion of the plurality of strokes of the digital ink taking into account the third selection, and
the machine-implemented method further comprises:
receiving a request to undo the attempt to correct the presented recognition result, and
rolling back an effect of the attempt to correct the presented recognition result in response to receiving the request to undo the attempt to correct the presented recognition result.

### Claim 4 (depends on 1)

The machine-implemented method of claim 1, further comprising:
permitting a user to rewrite the indicated at least one of the plurality of strokes, corresponding to the misrecognized portion of the recognition result, with newly entered digital ink including at least one stroke; and
re-recognizing at least a portion of the plurality of strokes of the digital ink taking into account the newly entered digital ink.

### Claim 5 (depends on 1)

The machine-implemented method of claim 1, further comprising:
receiving the plurality of strokes of the digital ink as a mathematical expression via an ink input window presented on a display screen; and
growing the ink input window as a portion of a stroke approaches an edge portion of the ink input window.

### Claim 6 (depends on 1)

The machine-implemented method of claim 1, wherein:
recognizing the digital ink input and presenting a recognition result further comprises:
attempting to produce the recognition result after receiving each of the plurality of strokes, wherein:
the digital ink represents a two dimensional structure.

### Claim 7 (depends on 1)

The machine-implemented method of claim 1, further comprising:
permitting a user to rewrite the indicated at least one of the plurality of strokes, corresponding to the misrecognized portion of the recognition results, with newly entered digital ink including at least one stroke;
re-recognizing, in real time, at least a portion of the plurality of strokes of the digital ink taking into account the newly entered digital ink; and
presenting a new recognition result based on the re-recognizing of the at least a portion of the plurality of strokes of the digital ink.

### Claim 8

A processing device comprising:
a processor;
a memory;
an input component;
an output component; and
a bus connecting the processor, the memory, the input component, and the output component, the memory comprising:
instructions for recognizing a plurality of strokes input as digital ink via the input component,
instructions for presenting a recognition result of the recognizing of the plurality of strokes of the digital ink, via the output component,
instructions for permitting a user to select at least one of the plurality of strokes corresponding to a misrecognized portion of a presented recognition result,
instructions for permitting a user to rewrite, via the input component, the selected at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result,
instructions for re-recognizing, in real time, at least a portion of the plurality of strokes input as digital ink, taking into account a rewritten portion of the plurality of strokes, to produce a new recognition result, and
instructions for presenting the new recognition result, via the output component.

### Claim 9 (depends on 8)

The processing device of claim 8, wherein the instructions for permitting a user to select at least one of the plurality of strokes corresponding to a misrecognized portion of a presented recognition result further comprise:
instructions for permitting the user to select the at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result by drawing a lasso encompassing the at least one of the plurality of strokes.

### Claim 10 (depends on 8)

The processing device of claim 8, wherein the instructions for permitting a user to select at least one of the plurality of strokes corresponding to a misrecognized portion of a presented recognition result further comprise:
instructions for permitting the user to select the at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result by drawing a stroke through the at least one of the plurality of strokes.

### Claim 11 (depends on 8)

The processing device of claim 8, wherein the memory further comprises:
instructions for performing a context-free recognition of the at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result to produce at least one first alternate recognition result,
instructions for performing a recognition of the at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result in context with at least one other stroke of the plurality of strokes input as the digital ink to produce at least one second alternate recognition result, and
instructions for presenting a plurality of alternate recognition results based on the plurality of alternate recognition results including the at least one first alternate recognition result and the at least one second alternate recognition result.

### Claim 12 (depends on 8)

The processing device of claim 8, wherein the memory further comprises:
instructions for presenting a menu of alternate recognition results when the user indicates a selection of at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result.

### Claim 14 (depends on 8)

The processing device of claim 8, wherein the memory further comprises:
instructions for presenting a multilevel menu of alternate recognition results when the user indicates a selection of at least one of the plurality of strokes corresponding to the misrecognized portion of the presented recognition result, wherein
ones of the alternate recognition results presented in a second level of the multilevel menu have a same structure of a selected one of ones of the alternate recognition results presented in a first level of the multilevel menu.

### Claim 15

A tangible machine-readable medium including instructions for at least one processor, the tangible machine-readable medium comprising:
instructions for recognizing a digital ink input representing one or more items of a two dimensional structure, the digital ink input including a plurality of strokes;
instructions for presenting a recognition result based on the recognizing of the digital ink input;
instructions for receiving a selection indicating at least one of the plurality of strokes corresponding to a misrecognized portion of the recognition result; and
instructions for making a rewriting feature discoverable, the rewriting feature being for permitting a user to rewrite the at least one of the plurality of strokes corresponding to the misrecognized portion of the recognition result.

### Claim 16 (depends on 15)

The tangible machine-readable medium of claim 15, wherein the instructions for making a rewriting feature discoverable further comprise:
instructions for displaying a rewrite message when a pointing device hovers over the selected at least one of the plurality of strokes corresponding to the misrecognized portion of the recognition result.

### Claim 17 (depends on 15)

The tangible machine-readable medium of claim 15, further comprising:
instructions for presenting at least one alternate recognition result, as a result of receiving the selection indicating at least one of the plurality of strokes corresponding to the misrecognized portion of the recognition result.

### Claim 18 (depends on 15)

The tangible machine-readable medium of claim 15, further comprising:
instructions for presenting at least one first alternate recognition result, as a result of receiving the selection indicating at least one of the plurality of strokes corresponding to the misrecognized portion of the recognition result;
instructions for presenting at least one second alternate recognition result, as a result of receiving a selection indicating one of the at least one first alternate recognition result, the presented at least one second alternate recognition result having a same structure as the presented at least one first alternate recognition result; and
instructions for correcting the presented recognition result based on a selected one of the at least one second alternate recognition result.

### Claim 19 (depends on 15)

The tangible machine-readable medium of claim 15, wherein the two dimensional structure includes a mathematical expression.

### Claim 20 (depends on 15)

The tangible machine-readable medium of claim 15, wherein the instructions for correcting the presented recognition result based on a selected one of the at least one second alternate recognition result further comprise:
re-recognizing the digital ink input taking into consideration the selected one of the at least one second alternate recognition result.
