US 11,537,359 B2Granted

Self-learning digital assistant

AssigneeMicrosoft Technology Licensing, LLC

InventorsAdi Miller, Roni Karassik, Danny Avigdor

Life of this patent

Estimating the term…

Loading patent…

Abstract

A response activity pattern may be ascertained from a set of computing devices obtained during a monitoring mode of operation. The monitoring mode of operation can be initiated when a user command is determined to be a new or unknown command. The response activity pattern may be used to generate a response profile indicating an activity to carry out using one or more user devices to perform a task associated with the user command. When an indication of a previously unknown user command to perform a task is received, the generated response profile can be used to perform the designed task by carrying out the activity using the one or more user device. In this way, the activity that should be carried out to perform the task can be learned based on the monitored user activity related to the one or more user devices.

Claims20

Dependent claims

A user-interactive computing device, comprising:

one or more processors;
and
computer storage memory having computer-executable instructions stored thereon which, when executed by the one or more processors, implement a method comprising:
receiving a first indication of a user command to perform a task;
determining that the user command is unrecognized;
based on the user command being unrecognized, triggering a heightened level of monitoring as compared to a level of monitoring when the first indication is received, the heightened level of monitoring comprising:
monitoring user-activity to determine a first response activity event comprising at least one user-activity operation performed by a user on at least one user device;
determining first contextual information associated with the first response activity event;
and
associating the first response activity event, comprising the at least one user-activity operation performed by the user, with the task, wherein associating the first response activity event with the task comprises associating the first contextual information with the first response activity event, and wherein the first contextual information distinguishes between the first response activity event associated with the user command and a second response activity event associated with the user command;
subsequent to associating the first response activity event with the task, receiving a second indication of the user command to perform the task;
determining current contextual information;
based on the second indication of the user command, the first contextual information, and the current contextual information, determining the first response activity event, comprising the at least one user-activity operation performed by the user, associated with the task;
and
causing the at least one user-activity operation to be performed to facilitate carrying out the task.

12 more elements

A computer-implemented method comprising:

receiving a first indication of a user command to perform a task;
determining that the user command is unrecognized;
based on the user command being unrecognized, triggering a monitoring session having a heightened level of monitoring as compared to a level of monitoring when the first indication is received to monitor user-activity associated with at least one user device;
determining a first response activity event based on the user-activity associated with the at least one user device from the monitoring session and comprising at least one user-activity operation performed by a user on the at least one user device;
associating the first response activity event, comprising the at least one user-activity operation performed by the user, with the user command, wherein associating the first response activity event with the user command comprises associating first contextual information with the first response activity event, and wherein the first contextual information distinguishes between the first response activity event associated with the user command and a second response activity event associated with the user command;
subsequent to associating the first response activity event with the user command, receiving a second indication of the user command to perform the task;
based on the second indication of the user command, the first contextual information, and current contextual information, determining the first response activity event, comprising the at least one user-activity operation performed by the user, associated with the user command;
and
based on the first response activity event, causing the at least one user-activity operation to be performed to facilitate carrying out the task.

6 more elements

A computerized system comprising:

one or more processors;
and
computer storage memory having computer-executable instructions stored thereon which, when executed by the one or more processors, implement a method comprising:
receiving a first indication of a user command to perform a task;
determining that the user command is unrecognized;
based on the user command being unrecognized, triggering a heightened level of monitoring as compared to a level of monitoring when the first indication is received;
monitoring user-activity at the heightened level of monitoring to determine a first response activity event comprising at least one user-activity operation performed by a user on at least one user device in a set of user devices associated with the user;
associating the first response activity event, comprising the at least one user-activity operation performed by the user, with the task, wherein associating the first response activity event with the task comprises associating first contextual information with the first response activity event, and wherein the first contextual information distinguishes between the first response activity event associated with the user command and a second response activity event associated with the user command;
subsequent to associating the first response activity event with the task, receiving a second indication of the user command to perform the task;
based on the second indication of the user command and the first contextual information, determining the first response activity event, comprising the at least one user-activity operation performed by the user, associated with the task;
and
causing the at least one user-activity operation to be performed to facilitate carrying out the task.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/368,658Filed 28 Mar 2019
Published: US 2020/0310749 A11 Oct 2020
Granted: 27 Dec 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

G06F 3/167
Sound input; Sound output: audio in a user interface, e.g. using voice commands for navigating, audio feedback
H04L 12/282
Controlling appliance services of a home automation network by calling their functionalities: based on user interaction within the home
G06F 9/4881
By program, e.g. task dispatcher, supervisor, operating system: scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue