US 2019/0096406 A1Published application

Task initiation using long-tail voice commands

AssigneeGoogle Inc.

InventorsYuzhao Ni, Bo Wang, Barnaby James, Pravir Gupta, David Schairer

Life of this patent

Estimating the term…

Loading patent…

Abstract

In various implementations, upon receiving a given voice command from a user, a voice-based trigger may be selected from a library of voice-based triggers previously used across a population of users. The library may include association(s) between each voice-based trigger and responsive action(s) previously performed in response to the voice-based trigger. The selecting may be based on a measure of similarity between the given voice command and the selected voice-based trigger. One or more responsive actions associated with the selected voice-based trigger in the library may be determined. Based on the one or more responsive actions, current responsive action(s) may be performed by the client device. Feedback associated with performance of the current responsive action(s) may be received from the user and used to alter a strength of an association between the selected voice-based trigger and the one or more responsive actions.

Claims20

Dependent claims

A method comprising:

receiving, at a first client device, a given voice command from a user;
identifying a context of the user detected using one or more sensors of the first client device or another client device;
selecting, from a library of voice-based triggers previously used across a population of users, a selected voice-based trigger, wherein the library includes one or more associations between each respective voice-based trigger of the library of voice-based triggers and one or more responsive actions previously invoked automatically at one or more other client devices operated by one or more other users of the population of users in response to the respective voice-based trigger, and wherein the selecting is based at least in part on a measure of similarity between the given voice command and the selected voice-based trigger;
determining a plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
based on the context of the user, selecting a given responsive action from the plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
performing, at a target client device controlled by the user, the given responsive action;
receiving, from the user, feedback associated with the performance of the given responsive action;
and
altering a strength of an association between the selected voice-based trigger and the given responsive action based on the feedback.

6 more elements

A system comprising one or more processors and memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to operate an interactive assistant module configured to perform the following operations:

receiving, at a first client device, a given voice command from a user;
identifying a context of the user detected using one or more sensors of the first client device or another client device;
selecting, from a library of voice-based triggers previously used across a population of users, a selected voice-based trigger, wherein the library includes one or more associations between each respective voice-based trigger of the library of voice-based triggers and one or more responsive actions previously invoked automatically at one or more other client devices operated by one or more other users of the population of users in response to the respective voice-based trigger, and wherein the selecting is based at least in part on a measure of similarity between the given voice command and the selected voice-based trigger;
determining a plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
based on the context of the user, selecting a given responsive action from the plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
performing, at a target client device controlled by the user, the given responsive action;
receiving, from the user, feedback associated with the performance of the given responsive action;
and
altering a strength of an association between the selected voice-based trigger and the given responsive action based on the feedback.

6 more elements

At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to perform the following operations:

receiving, at a first client device, a given voice command from a user;
identifying a context of the user detected using one or more sensors of the first client device or another client device;
selecting, from a library of voice-based triggers previously used across a population of users, a selected voice-based trigger, wherein the library includes one or more associations between each respective voice-based trigger of the library of voice-based triggers and one or more responsive actions previously invoked automatically at one or more other client devices operated by one or more other users of the population of users in response to the respective voice-based trigger, and wherein the selecting is based at least in part on a measure of similarity between the given voice command and the selected voice-based trigger;
determining a plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
based on the context of the user, selecting a given responsive action from the plurality of candidate responsive actions associated with the selected voice-based trigger in the library;
performing, at a target client device controlled by the user, the given responsive action;
receiving, from the user, feedback associated with the performance of the given responsive action;
and
altering a strength of an association between the selected voice-based trigger and the given responsive action based on the feedback.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/203,521Filed 28 Nov 2018
Priority: 3 Oct 2016
Published: 28 Mar 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification15 codes

G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue
G10L 15/063
Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice: training
G10L 15/1815
Using natural language modelling: semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
G10L 15/1822
Using natural language modelling: parsing for meaning understanding

Family

Application15/284,473Continuation · filed 3 Oct 2016
Application16/203,521Continuation
US 10,297,254 B2Related patent
US 10,490,190 B2Related patent
US 2018/0096681 A1Published application
US 2019/0096406 A1This patent

From the US filing history. Foreign family members aren’t listed.