# US 10,871,880 B2 · Action-enabled inking tools > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,871,880 B2 - Document ID: US10871880B2 - Status: Granted - Kind: B2 - Application number: 15/344,439 - Filed: 2016-11-04 - Published: 2018-05-10 - Granted: 2020-12-22 - Earliest claimed: 2016-11-04 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: L. Tucker Hatfield; Ian William Mikutel; Emily Tran; Alex J. Simmons; Lisa Carolyn Cherian - Web page: https://patentgrep.com/patent/US10871880B2 ## CPC - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 40/171: by use of digital ink - G06V 30/32: Digital ink - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A tool for action tool-integrated inking input is provided. In one example, a user selects an inking tool and further selects an action functionality to apply to the inking tool. The inking tool is highlighted and updated to display the selected functionality. In another example, the user selects an action tool having a particular functionality and further selects inking properties to apply to the action tool. The action tool is highlighted and updated to display the selected inking properties. In another example, a tool is provided, and the user selects an action functionality and inking properties to apply to the tool. The action tool is updated to illustrate the selected functionality and properties. In another example, the user selects an inking tool and an action tool to apply properties associated with the inking tool and the functionality associated with the action tool to an active tool. ## Claims ### Claim 1 A computer-implemented method for providing an action-enabled inking tool, the method comprising: displaying a user interface of an application within a display of an electronic computing device, the user interface comprising a content authoring canvas and a plurality of inking tools for editing content in the content authoring canvas; receiving a selection of an inking tool from the plurality of inking tools and displaying a first customization menu to allow a user to select properties and a functionality for the inking tool; receiving a selection of the properties and the functionality for the inking tool and setting the inking tool to have the selected properties and the selected functionality for editing the content; based on a type of the selected functionality, displaying a second customization menu to allow the user to select a plurality of properties specific to the type of the selected functionality, wherein the plurality of properties specific to the type of the selected functionality are associated with commands for editing the content; receiving a selection of a plurality of properties specific to the type of the selected functionality and selected from the second customization menu, and applying the plurality of properties selected from the second customization menu to the inking tool; receiving inking input via the inking tool analyzing the inking input to identify a first portion of the inking input that corresponds to a first property of the plurality of properties selected from the second customization menu; analyzing the inking input to identify a second portion of the inking input that corresponds to a second property of the plurality of properties selected from the second customization menu; executing one or more commands associated with the first property of the plurality of properties to edit the content in accordance with the selected first property; and executing one or more commands associated with the second property of the plurality of properties to edit the content in accordance with the selected second property. ### Claim 2 (depends on 1) The method of claim 1, further comprising persistently highlighting the inking tool. ### Claim 3 (depends on 1) The method of claim 1, wherein displaying the first customization menu further comprises displaying a plurality of action tools for allowing the user to select the inking tool. ### Claim 4 (depends on 3) The method of claim 3, wherein each of the plurality of action tools has an associated functionality, the associated functionality comprising one of the following: converting the inking input to a shape; converting the inking input to a mathematical equation; revising content based on the inking input; converting the inking input to a chemical equation; and converting the inking input to a music score. ### Claim 5 (depends on 4) The method of claim 4, wherein the selection of the inking tool comprises selecting an action tool displayed in the first customization menu. ### Claim 6 (depends on 5) The method of claim 5, wherein displaying the user interface comprises displaying a toolbar, the toolbar comprising the inking tool; and setting the inking tool to have the selected properties and the selected functionality further comprises updating the display of the inking tool in the toolbar to illustrate the selected functionality. ### Claim 7 (depends on 6) The method of claim 6, wherein updating the display of the inking tool to illustrate the selected functionality comprises updating the display of the inking tool to include an icon corresponding to the selected functionality, wherein the icon comprises one of the following: the icon corresponding to converting inking input to a shape includes a geometric shape; the icon corresponding to converting inking input to a mathematical equation includes a mathematical symbol; the icon corresponding to revising content based on inking input includes at least one proofreading symbol; the icon corresponding to converting inking input to a chemical equation includes a chemical symbol; and the icon corresponding to converting inking input to a music score includes a musical symbol. ### Claim 8 (depends on 1) The method of claim 1, wherein displaying the user interface comprises displaying the inking tool having a functionality associated with one of the following: converting inking input to a shape; converting inking input to a mathematical equation; revising content based on inking input; converting inking input to a chemical equation; and converting inking input to a music score. ### Claim 9 (depends on 1) The method of claim 1, wherein each of the plurality of inking tools has a separate functionality, the separate functionality comprising one of the following: converting inking input to a shape; converting inking input to a mathematical equation; revising content based on inking input; converting inking input to a chemical equation; and converting inking input to a music score. ### Claim 10 (depends on 1) The method of claim 1, wherein displaying the first customization menu comprises displaying the first customization menu to allow the user to select one or more properties for the inking tool selected from the following: a color; a stroke thickness; and an ink effect. ### Claim 11 (depends on 10) The method of claim 10, wherein setting the inking tool to have the selected properties further comprises updating the display of the inking tool to illustrate the selected properties. ### Claim 12 (depends on 11) The method of claim 11, wherein updating the display of the inking tool to illustrate the selected properties comprises updating the inking tool to illustrate the selected color and stroke thickness. ### Claim 13 A method for providing an action-enabled inking tool, comprising: displaying a user interface of an application within a display of an electronic computing device, the user interface comprising a content authoring canvas and a plurality of inking tools having properties; receiving a selection of an inking tool from the plurality of inking tools and displaying a first customization menu to allow a user to select a functionality for the inking tool; responsive to a selection of the functionality for the inking tool, setting the inking tool to have the selected functionality; based on a type of the selected functionality, displaying a second customization menu to allow the user to select a plurality of properties specific to the type of the selected functionality, wherein the plurality of properties specific to the type of the selected functionality are associated with commands for editing content, and a selected property from the second customization menu is applied to the inking tool; receiving a selection of a plurality of properties specific to the type of the selected functionality and selected from the second customization menu, and applying the plurality of properties selected from the second customization menu to the inking tool; receiving an inking input via the inking tool; analyzing the inking input to identify a first portion of the inking input that corresponds to a first property of the plurality of properties selected from the second customization menu; analyzing the inking input to identify a second portion of the inking input that corresponds to a second property of the plurality of properties selected from the second customization menu; executing one or more commands associated with the first property of the plurality of properties to edit the content in accordance with the selected first property; and executing one or more commands associated with the second property of the plurality of properties to edit the content in accordance with the selected second property. ### Claim 14 (depends on 13) The method of claim 13, wherein displaying the first customization menu comprises displaying functionalities comprising: a functionality for converting the inking input to a shape; a functionality for converting the inking input to a mathematical equation; a functionality for revising content based on the inking input; a functionality for converting the inking input to a chemical equation; and a functionality for converting the inking input to a music score. ### Claim 15 (depends on 14) The method of claim 14, wherein: displaying the user interface comprises displaying a toolbar, the toolbar comprising the inking tool; and setting the inking tool to have the selected functionality further comprises updating the display of the inking tool in the toolbar to illustrate the selected functionality. ### Claim 16 (depends on 15) The method of claim 15, wherein updating the display of the inking tool to illustrate the selected functionality comprises updating the display of the inking tool to include an icon corresponding to the selected functionality, wherein updating the display of the inking tool comprises to include one of the following: the icon corresponding to converting inking input to a shape includes a geometric shape; the icon corresponding to converting inking input to a mathematical equation includes a mathematical symbol; the icon corresponding to revising content based on inking input includes at least one proofreading symbol; the icon corresponding to converting inking input to a chemical equation includes a chemical symbol; and the icon corresponding to converting inking input to a music score includes a musical symbol. ### Claim 17 (depends on 13) The method of claim 13, further comprising persistently highlighting the inking tool. ### Claim 18 A system for providing an action-enabled inking tool, the system comprising: a processing device; and a computer readable data storage device storing instructions that, when executed by the processing device, cause the system to: display a user interface within a display of an electronic computing device, the user interface comprising a content authoring canvas and a plurality of inking tools for editing content in the content authoring canvas; in response to a selection of an inking tool from the plurality of inking tools, display a first customization menu to allow a user to select a functionality for the inking tool; in response to a selection of the functionality for the inking tool, set the inking tool to have the selected functionality for editing the content; based on a type of the selected functionality, display a second customization menu to allow the user to select a plurality of properties specific to the type of the selected functionality, wherein the plurality of properties specific to the type of the selected functionality are associated with commands for editing the content; in response to a selection of a plurality of properties specific to the type of the selected functionality and selected from the second customization menu, apply the plurality of properties selected from the second customization menu to the inking tool; in response to receiving inking input via the inking tool: analyze the inking input to identify a first portion of the inking input that corresponds to a first property of the plurality of properties selected from the second customization menu; analyze the inking input to identify a second portion of the inking input that corresponds to a second property of the plurality of properties selected from the second customization menu; execute one or more commands associated with the first property of the plurality of properties to edit the content in accordance with the selected first property; and execute one or more commands associated with the second property of the plurality of properties to edit the content in accordance with the selected second property. ### Claim 19 (depends on 18) The system of claim 18, wherein the functionality associated with the selected inking tool comprises at least one of the following: a functionality for converting inking input to a shape; a functionality for converting inking input to a mathematical equation; a functionality for revising content based on inking input; a functionality for converting inking input to a chemical equation; and a functionality for converting inking input to a music score.