# US 2013/0159938 A1 · Gesture inferred vocabulary bindings > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0159938 A1 - Document ID: US20130159938A1 - Status: Published application - Kind: A1 - Application number: 13/329,165 - Filed: 2011-12-16 - Published: 2013-06-20 - Earliest claimed: 2011-12-16 - Assignees: Microsoft Corporation - Inventors: Alex James; Michael Pizzo; Pablo Castro; Michael Justin Flasko; Lance Olson; Jason Clark; Siddharth Jayadevan - Web page: https://patentgrep.com/patent/US20130159938A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The subject disclosure relates to annotating data based on gestures. Gestures include user interaction with a client device or client software. Gestures are tracked and associated with data. In an aspect, client context associated with a gesture is also tracked. The gestures are then employed to determine a global term to associate with the data. In an aspect, a look-up table comprising a pre-defined relationship between gestures and a global term can be employed. In another aspect, an inference component employ context information in conjunction with the tracked gestures to determine a global term to assign to data. After a global term is determined for data based on a gesture, an annotation file for the data can be created associating the data with the global term. ## Claims ### Claim 1 A computer-implemented system, comprising: a tracking component configured to track a gesture and associate the gesture with data, wherein the gesture includes user interaction with a client; and an analysis component configured to determine a global term to assign to the data based on the gesture. ### Claim 2 (depends on 1) The computer-implemented system of claim 1, further comprising: a data store configured to store a look-up table that associates gestures with global terms, wherein the analysis component is configured to employ the look-up table to determine the global term to assign to the data. ### Claim 3 (depends on 2) The computer-implemented system of claim 2, wherein the look-up table further associates the gestures with the global terms based on at least one of a client identity or a data-type. ### Claim 4 (depends on 1) The computer-implemented system of claim 1, wherein the tracking component is further configured to track context information associated with the gesture; the computer-implemented system further comprising: an inference component configured to determine the global term to assign to the data based on the context information. ### Claim 5 (depends on 4) The computer-implemented system of claim 4, wherein the context information includes a response to the gesture by the client. ### Claim 6 (depends on 4) The computer-implemented system of claim 4, wherein the context information includes an annotation on the data, wherein the annotation includes an association of an other global term with the data. ### Claim 7 (depends on 1) The computer-implemented system of claim 1, further comprising: an annotation component configured to generate an annotation file comprising an assignment of the global term to the data. ### Claim 8 A method, comprising: tracking a gesture, wherein the gesture includes user interaction with a client; associating the gesture with data; and determining a global term to assign to the data based on the gesture. ### Claim 9 (depends on 8) The method of claim 8, further comprising: associating gestures with global terms in a look-up table; and employing the look-up table in the determining the global term to assign to the data based on the gesture. ### Claim 10 (depends on 8) The method of claim 8, further comprising: associating gestures with global terms in a look-up table based on at least one of a client identity or a data-type; and employing the look-up table in the determining the global term to assign to the data based on the gesture. ### Claim 11 (depends on 8) The method of claim 8, further comprising: tracking context information associated with the gesture, wherein the determining the global term to assign to the data based on the gesture further comprises determining the global term to assign to the data based on the context information. ### Claim 12 (depends on 11) The method of claim 11, wherein the context information includes a response to the gesture by the client. ### Claim 13 (depends on 11) The method of claim 11, wherein the context information includes an annotation on the data, wherein the annotation includes an association of an other global term with the data. ### Claim 14 (depends on 13) The method of claim 13, further comprising: employing a search engine external from the client to find suggested global terms based on the other global term; and employing the suggested global terms in the determining the global term to assign to the data based on the gesture. ### Claim 15 (depends on 8) The method of claim 8, further comprising: generating an annotation file comprising an assignment of the global term to the data. ### Claim 16 (depends on 15) The method of claim 15, further comprising: sending the annotation file to an external data store. ### Claim 17 A computer readable storage medium comprising computer executable instructions that, in response to execution, cause a computing system to perform operations, comprising: tracking a gesture, wherein the gesture includes user interaction with a client; associating the gesture with data; and determining a global term to assign to the data based on the gesture. ### Claim 18 (depends on 17) The computer readable storage medium of claim 17, the operations further comprising: associating gestures with global terms in a look-up table; and employing the look-up table in the determining the global term to assign to the data based on the gesture. ### Claim 19 (depends on 18) The computer readable storage medium of claim 18, the operations further comprising: associating gestures with global terms in a look-up table based on at least one of a client identity or a data-type; and employing the look-up table in the determining the global term to assign to the data based on the gesture. ### Claim 20 (depends on 18) The computer readable storage medium of claim 18, the operations further comprising: tracking context information associated with the gesture, wherein the determining the global term to assign to the data based on the gesture further comprises determining the global term to assign to the data based on the context information.