# US 2020/0401612 A1 · Computer speech recognition and semantic understanding from activity patterns > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401612 A1 - Document ID: US20200401612A1 - Status: Published application - Kind: A1 - Application number: 17/011,064 - Filed: 2020-09-03 - Published: 2020-12-24 - Earliest claimed: 2015-11-13 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Dikla DOTAN-COHEN; Shira WEINBERG - Web page: https://patentgrep.com/patent/US20200401612A1 ## CPC - G06F 16/335: Filtering based on additional data, e.g. user or group profiles (filtering in web context G06F16/9535, G06F16/9536) - G06F 16/957: Browsing optimisation, e.g. caching or content distillation - G06F 40/30: Semantic analysis - G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202) - G06Q 10/101: Collaborative creation, e.g. joint development of products or services - H04W 4/02: Services making use of location information - H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences - H04W 4/029: Location-based management or tracking services - H04W 4/18: Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals - H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds} - H04W 4/027: {using movement velocity, acceleration information} - H04W 4/08: User group management - Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management - Y02D 30/70: in wireless communication networks - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE ## Abstract A user activity pattern may be ascertained using signal data from a set of computing devices. The activity pattern may be used to infer user intent with regards to a user interaction with a computing device or to predict a likely future action by the user. In one implementation, a set of computing devices is monitored to detect user activities using sensors associated with the computing devices. Activity features associated with the detected user activities are determined and used to identify an activity pattern based on a plurality of user activities having similar features. Examples of user activity patterns may include patterns based on time, location, content, or other context. The inferred user intent or predicted future actions may be used to facilitate understanding user speech or determining a semantic understanding of the user. ## Claims ### Claim 1 A computerized system comprising: one or more processors; and computer storage memory having computer-executable instructions stored thereon which, when executed by the processor, implement a method of disambiguating an indication of a user interaction, the method comprising: a) receiving a set of words forming an indication of a user interaction; b) logging user activity in a pipeline; c) disambiguating the meaning of a subset of the set of words forming the indication of the user interaction based on a sequence of events in the pipeline; and d) performing a computerized action based on the disambiguated meaning. ### Claim 2 (depends on 1) The computerized system of claim 1, wherein the indication of the user interaction is formed from sensor data containing a user utterance. ### Claim 3 (depends on 1) The computerized system of claim 1, wherein the sequence of events comprises events with similar time period. ### Claim 4 (depends on 3) The computerized system of claim 3, wherein the sequence of events comprises events with similar location. ### Claim 5 (depends on 3) The computerized system of claim 3, wherein the sequence of events comprises events that involve similar content. ### Claim 6 (depends on 1) The computerized system of claim 1, wherein the subset of words are determined to be consistent with a determined activity event. ### Claim 7 (depends on 6) The computerized system of claim 6, wherein the determined activity event comprises one or more of browsing to a website, launching an application, initiating a communication, performing a search query, setting a reminder, or scheduling an event on a calendar. ### Claim 8 (depends on 1) The computerized system of claim 1, wherein the user is provided an indication of the determined subset of words. ### Claim 9 A computer-implemented method of disambiguating an indication of a user interaction, the method comprising: a) receiving a set of words forming an indication of a user interaction; b) logging user activity in a data store; c) determining a user intent for a subset of the words forming the user indication based on a sequence of events in the data store; and d) performing a computerized action based on the the user intent. ### Claim 10 (depends on 9) The method of claim 9, wherein the indication of the user interaction is formed from sensor data containing a user utterance. ### Claim 11 (depends on 9) The computerized of claim 9, wherein the sequence of events comprises events with similar time period. ### Claim 12 (depends on 11) The method of claim 11, wherein the sequence of events comprises events with similar location. ### Claim 13 (depends on 11) The method of claim 11, wherein the sequence of events comprises events that involve similar content. ### Claim 14 (depends on 9) The method of claim 9, wherein the subset of words are determined to be consistent with a determined activity event. ### Claim 15 A computerized system comprising: one or more sensors configured to provide sensor data, each sensor associated with a user device in a set of user devices associated with a user, at least one of the one or more sensors comprising an acoustic sensor configured to convert speech into acoustic information; one or more processors; and computer storage memory having computer-executable instructions stored thereon which, when executed by the processor, implement a method of disambiguating an indication of a user interaction, the method comprising: a) receiving a set of words forming an indication of a user interaction, from sensor data corresponding to a user utterance; b) logging user activity in a data store; c) disambiguating the meaning of a subset of the set of words forming the indication of the user interaction based on a plurality of events in the data store; and d) performing a computerized action based on the disambiguated meaning. ### Claim 16 (depends on 15) The computerized system of claim 15, wherein the plurality of events comprises events with similar time period. ### Claim 17 (depends on 16) The computerized system of claim 16, wherein the plurality of events comprises events with similar location. ### Claim 18 (depends on 16) The computerized system of claim 16, wherein the plurality of events comprises events that involve similar content. ### Claim 19 (depends on 15) The computerized system of claim 15, wherein the subset of words are determined to be consistent with a determined activity event. ### Claim 20 (depends on 15) The computerized system of claim 15, wherein the user is provided an indication of the determined subset of words.