# US 2019/0377433 A1 · Multi-stroke smart ink gesture language > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0377433 A1 - Document ID: US20190377433A1 - Status: Published application - Kind: A1 - Application number: 16/547,192 - Filed: 2019-08-21 - Published: 2019-12-12 - Earliest claimed: 2017-05-31 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Jan-Kristian Markiewicz; Robert Joseph Disano; Christian Klein - Web page: https://patentgrep.com/patent/US20190377433A1 ## CPC - G06F 3/03545: {Pens or stylus} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06V 30/347: {Sampling; Contour coding; Stroke extraction} - G06V 30/36: {Matching; Classification} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract This document describes techniques for, and systems that enable, a multi-stroke smart ink gesture language. The described techniques enable a digital ink user interface that allows a display, that is capable of receiving a digital ink stroke from a passive stylus or an active pen, to receive the digital ink stroke as either a content input or an action input. The digital ink stroke may be determined to be an action input based on proximity to, intersection with, or chronological immediacy to a prior-received digital ink stroke. When multiple digital ink strokes are determined to represent a multi-stroke gesture associated with an action input, the action input is provided to the application, which can then perform the action associated with the action input. The multi-stroke gesture allows users to input both content and actions using the passive stylus or active pen and natural digital inking strokes. ## Claims ### Claim 1 A computer-implemented method, comprising: receiving two or more digital ink strokes in a graphical user interface; recognizing, based on a detected proximity of the two or more digital ink strokes to content displayed in the graphical user interface and a chronological immediacy time duration associated with a receipt of the two or more digital ink strokes, that a receipt of the two or more digital ink strokes represents a pre-configured ink gesture configured to automatically execute an action on the content; and executing the action on the content based on a recognition that the receipt of the two or more digital ink strokes represents the pre-configured ink gesture. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the action alters a format of the content displayed in the graphical user interface. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein the format is a heading format of the content. ### Claim 4 (depends on 2) The computer-implemented method of claim 2, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that selects the underlined content. ### Claim 5 (depends on 2) The computer-implemented method of claim 2, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that underlines the content. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein the two or more digital ink strokes comprise a first input that draws an object around the content and a second input that selects the content having the object drawn therearound. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the action results in a highlighting of the content in the graphical user interface. ### Claim 8 A system comprising: at least one processor; and a memory, operatively connected with the at least one processor, storing computer-executable instructions that, when executed by the at least one processor, causes the at least one processor to execute a method that comprises: receiving two or more digital ink strokes in a graphical user interface; recognizing, based on a detected proximity of the two or more digital ink strokes to content displayed in the graphical user interface and a chronological immediacy time duration associated with a receipt of the two or more digital ink strokes, that a receipt of the two or more digital ink strokes represents a pre-configured ink gesture configured to automatically execute an action on the content; and executing the action on the content based on a recognition that the receipt of the two or more digital ink strokes represents the pre-configured ink gesture. ### Claim 9 (depends on 8) The system of claim 8, wherein the action alters a format of the content displayed in the graphical user interface. ### Claim 10 (depends on 9) The system of claim 9, wherein the format is a heading format of the content. ### Claim 11 (depends on 9) The system of claim 9, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that selects the underlined content. ### Claim 12 (depends on 9) The system of claim 9, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that underlines the content. ### Claim 13 (depends on 8) The system of claim 8, wherein the two or more digital ink strokes comprise a first input that draws an object around the content and a second input that selects the content having the object drawn therearound. ### Claim 14 (depends on 13) The system of claim 13, wherein the action results in a highlighting of the content in the graphical user interface. ### Claim 15 A computer storage media storing computer-executable instructions that, when executed by at least one processor, causes the at least one processor to execute a method comprising: receiving two or more digital ink strokes in a graphical user interface; recognizing, based on a detected proximity of the two or more digital ink strokes to content displayed in the graphical user interface and a chronological immediacy time duration associated with a receipt of the two or more digital ink strokes, that a receipt of the two or more digital ink strokes represents a pre-configured ink gesture configured to automatically execute an action on the content; and executing the action on the content based on a recognition that the receipt of the two or more digital ink strokes represents the pre-configured ink gesture. ### Claim 16 (depends on 15) The computer storage media of claim 15, wherein the action alters a format of the content displayed in the graphical user interface. ### Claim 17 (depends on 16) The computer storage media of claim 16, wherein the format is a heading format of the content. ### Claim 18 (depends on 16) The computer storage media of claim 16, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that selects the underlined content. ### Claim 19 (depends on 16) The computer storage media of claim 16, wherein the two or more digital ink strokes comprise a first input that underlines the content and a second input that underlines the content. ### Claim 20 (depends on 15) The computer storage media of claim 15, wherein the two or more digital ink strokes comprise a first input that draws an object around the content and a second input that selects the content having the object drawn therearound, and wherein the action results in a highlighting of the content in the graphical user interface.