# US 2019/0317988 A1 · Presenting an overlay canvas to ink edit typed text

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317988 A1
- Document ID: US20190317988A1
- Status: Published application
- Kind: A1
- Application number: 15/952,911
- Filed: 2018-04-13
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Elise Livingston; Adam Samuel Riddle; L. Tucker Hatfield (deceased); Charles Cummins; Allison Smedley
- Web page: https://patentgrep.com/patent/US20190317988A1

## CPC

- G06F 40/171: by use of digital ink
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems, methods, and software are disclosed herein for presenting an overlay canvas in response to receiving an editing gesture to existing text on a canvas. In an implementation, user input is received comprising an inking gesture associated with existing text displayed on a canvas in a user interface. The inking gesture is then determined to comprise any of a plurality of editing gestures. In response to the inking gesture comprising an editing gesture, an overlay canvas is presented above the canvas in the user interface. Additional user input is received comprising inking on the overlay canvas. The inking is then incorporated into the existing text on the canvas.

## Claims

### Claim 1

A computer apparatus comprising:
one or more computer readable storage media;
one or more processors operatively coupled to the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media that, when executed by the one or more processors, direct the one or more processors to at least:
receive user input comprising an inking gesture associated with existing text displayed on a canvas in a user interface;
determine if the inking gesture comprises any of a plurality of editing gestures;
in response to the inking gesture comprising an editing gesture, present an overlay canvas above the canvas in the user interface;
receive additional user input comprising inking on the overlay canvas; and
incorporate the inking into the existing text on the canvas.

### Claim 2 (depends on 1)

The computer apparatus of claim 1 wherein the program instructions further direct the one or more processors to identify an instruction corresponding to the editing gesture from a set of instructions each associated with an editing gesture.

### Claim 3 (depends on 2)

The computer apparatus of claim 2 wherein the set of instructions comprises at least one of an instruction to insert the inking at a location where the editing gesture was written, replace a portion of the existing text with the inking, attach a comment card containing the inking to the existing text, insert a footnote or a citation including the inking to the existing text, or insert the inking into a visual construct rendered on the canvas in association with the existing text.

### Claim 4 (depends on 1)

The computer apparatus of claim 1 wherein the inking comprises handwritten text and wherein to incorporate the inking into the existing text on the canvas the program instructions direct the one or more processors to:
convert the handwritten text to typewritten text; and
incorporate the typewritten text into the existing text on the canvas.

### Claim 5 (depends on 1)

The computer apparatus of claim 1 wherein the editing gesture comprises inking at least one of a symbol, a circle, an arrow, an underline, or a set of brackets associated with the existing text displayed on the canvas in the user interface.

### Claim 6 (depends on 1)

The computer apparatus of claim 1 wherein the overlay canvas comprises a semi-transparent canvas layered on top of the canvas.

### Claim 7 (depends on 1)

The computer apparatus of claim 1 wherein the program instructions further direct the one or more processors to:
render a content item comprising the existing text on the canvas; and
incorporate the inking into the content item comprising the existing text on the canvas.

### Claim 8 (depends on 1)

The computer apparatus of claim 1 wherein the program instructions further direct the one or more processors to incorporate the inking into the existing text on the canvas according to formatting settings associated with the existing text.

### Claim 9

A method comprising:
receiving user input comprising an inking gesture associated with existing text displayed on a canvas in a user interface;
determining if the inking gesture comprises any of a plurality of editing gestures;
in response to the inking gesture comprising an editing gesture, presenting an overlay canvas above the canvas in the user interface;
receiving additional user input comprising inking on the overlay canvas; and
incorporating the inking into the existing text on the canvas.

### Claim 10 (depends on 9)

The method of claim 9 further comprising identifying an instruction corresponding to the editing gesture from a set of instructions each associated with an editing gesture.

### Claim 11 (depends on 10)

The method of claim 10 wherein the set of instructions comprises at least one of an instruction to insert the inking at a location where the editing gesture was written, replace a portion of the existing text with the inking, attach a comment card containing the inking to the existing text, insert a footnote or a citation including the inking to the existing text, or insert the inking into a visual construct rendered on the canvas in association with the existing text.

### Claim 12 (depends on 9)

The method of claim 9 wherein the inking comprises handwritten text and wherein incorporating the inking into the existing text on the canvas comprises:
converting the handwritten text to typewritten text; and
incorporating the typewritten text into the existing text on the canvas.

### Claim 13 (depends on 9)

The method of claim 9 wherein the editing gesture comprises inking at least one of a symbol, a circle, an arrow, an underline, or a set of brackets associated with the existing text displayed on the canvas in the user interface.

### Claim 14 (depends on 9)

The method of claim 9 wherein the overlay canvas comprises a semi-transparent canvas layered on top of the canvas.

### Claim 15 (depends on 9)

The method of claim 9 further comprising:
rendering a content item comprising the existing text on the canvas; and
incorporating the inking into the content item comprising the existing text on the canvas.

### Claim 16 (depends on 9)

The method of claim 9 further comprising incorporating the inking into the existing text on the canvas according to formatting settings associated with the existing text.

### Claim 17

One or more computer readable storage media having program instructions stored thereon, wherein the program instructions, when executed by one or more processors, direct the one or more processors to at least:
receive user input comprising an inking gesture associated with existing text displayed on a canvas in a user interface;
determine if the inking gesture comprises any of a plurality of editing gestures;
in response to the inking gesture comprising an editing gesture, present an overlay canvas above the canvas in the user interface;
receive additional user input comprising inking on the overlay canvas; and
incorporate the inking into the existing text on the canvas.

### Claim 18 (depends on 17)

The one or more computer readable storage media of claim 17 wherein the program instructions further direct the one or more processors to identify an instruction corresponding to the editing gesture from a set of instructions each associated with an editing gesture.

### Claim 19 (depends on 18)

The one or more computer readable storage media of claim 18 wherein the set of instructions comprises at least one of an instruction to insert the inking at a location where the editing gesture was written, replace a portion of the existing text with the inking, attach a comment card containing the inking to the existing text, insert a footnote or a citation including the inking to the existing text, or insert the inking into a visual construct rendered on the canvas in association with the existing text.

### Claim 20 (depends on 17)

The one or more computer readable storage media of claim 17 wherein the inking comprises handwritten text and wherein to incorporate the inking into the existing text on the canvas the program instructions direct the one or more processors to:
convert the handwritten text to typewritten text; and
incorporate the typewritten text into the existing text on the canvas.
