US 12,119,007 B2Granted

Dynamically adapting fulfillment of a given spoken utterance based on a user that provided the given spoken utterance

AssigneeGoogle Inc.

InventorsAmit Singhal, Dev M. Patel, Yao Lin, Arvind Sivaram Sharma, Srikrishnan Subramanian

Life of this patent

Estimating the term…

Loading patent…

Abstract

Implementations described herein relate to determining how to fulfill a spoken utterance based on a user that provided the spoken utterance. For example, implementations can receive a spoken utterance from a user, determine a set of fulfillment actions for the spoken utterance, and determine whether the user that provided the spoken utterance corresponds to a first user or a second user. Further, and in response to determining that the user corresponds to the first user, implementations can select a subset of first fulfillment action(s) from the set, and cause the subset of first fulfillment action(s) to be implemented to satisfy the spoken utterance. Moreover, and in response to determining that the user corresponds to the second user, implementations can select a subset of distinct, second fulfillment action(s) from the set, and cause the subset of second fulfillment action(s) to be implemented to satisfy the spoken utterance.

Claims20

Dependent claims

A method implemented by one or more processors comprising:

receiving, from a user and via a computing device, a given spoken utterance, the given spoken utterance being provided while the user is located in a vehicle of the user;
determining, based on processing the given spoken utterance, a set of fulfillment actions, wherein each fulfillment action included in the set of fulfillment actions, when implemented, is in furtherance of satisfying the given spoken utterance, and wherein each fulfillment action included in the set of fulfillment actions is associated with controlling a corresponding component of the vehicle;
determining whether the user that provided the given spoken utterance corresponds to a first user or a second user;
in response to determining that the user that provided the given spoken utterance corresponds to the first user:
selecting, based on the user that provided the given spoken utterance corresponding to the first user, a subset of one or more first fulfillment actions from the set of fulfillment actions, wherein the subset of one or more first fulfillment actions is associated with controlling at least a first component of the vehicle;
and
causing the subset of one or more first fulfillment actions to be implemented to satisfy the given spoken utterance;
and
in response to determining that the user that provided the given spoken utterance corresponds to the second user:
selecting, based on the user that provided the given spoken utterance corresponding to the second user, a subset of one or more second fulfillment actions from the set of fulfillment actions, wherein the second user is an additional user that is in addition to the first user and wherein the subset of one or more second fulfillment actions is associated with controlling at least a second component of the vehicle that is not controlled when the subset of the one or more first fulfilment actions is implemented;
and
causing the one or more second fulfillment actions to be implemented to satisfy the given spoken utterance.

9 more elements

A method implemented by one or more processors comprising:

receiving, from a user and via a computing device, a given spoken utterance, the given spoken utterance being provided while the user is located in a primary dwelling of the user;
determining, based on processing the given spoken utterance, a set of fulfillment actions, wherein each fulfillment action included in the set of fulfillment actions, when implemented, is in furtherance of satisfying the given spoken utterance, and wherein each fulfillment action included in the set of fulfillment actions is associated with controlling a corresponding Internet-of-Thing (IoT) device and using a corresponding set of parameters;
determining whether the user that provided the given spoken utterance corresponds to a first user or a second user;
in response to determining that the user that provided the given spoken utterance corresponds to a first user:
selecting, based on the user that provided the given spoken utterance corresponding to the first user, a subset of one or more first fulfillment actions from the set of fulfillment actions, wherein the subset of one or more first fulfillment actions is associated with controlling the corresponding IoT device using a first set of parameters;
and
causing the subset of one or more first fulfillment actions to be implemented to satisfy the given spoken utterance;
and
in response to determining that the user that provided the given spoken utterance corresponds to the second user:
selecting, based on the user that provided the given spoken utterance corresponding to the second user, a subset of one or more second fulfillment actions from the set of fulfillment actions, wherein the second user is an additional user that is in addition to the first user and wherein the subset of one or more second fulfillment actions is associated with controlling the corresponding IoT device using a second set of parameters that differs from the first set of parameters;
and
causing the one or more second fulfillment actions to be implemented to satisfy the given spoken utterance.

9 more elements

A system comprising:

at least one processor;
and
memory storing instructions that, when executed, cause the at least one processor to be operable to:
receive, from a user and via a computing device, a given spoken utterance, the given spoken utterance being provided while the user is located in a vehicle of the user;
determine, based on processing the given spoken utterance, a set of fulfillment actions, wherein each fulfillment action included in the set of fulfillment actions, when implemented, is in furtherance of satisfying the given spoken utterance, and wherein each fulfillment action included in the set of fulfillment actions is associated with controlling a corresponding component of the vehicle;
determine whether the user that provided the given spoken utterance corresponds to a first user or a second user;
in response to determining that the user that provided the given spoken utterance corresponds to the first user:
select, based on the user that provided the given spoken utterance corresponding to the first user, a subset of one or more first fulfillment actions from the set of fulfillment actions, wherein the subset of one or more first fulfillment actions is associated with controlling at least a first component of the vehicle;
and
cause the subset of one or more first fulfillment actions to be implemented to satisfy the given spoken utterance;
and
in response to determining that the user that provided the given spoken utterance corresponds to the second user:
select, based on the user that provided the given spoken utterance corresponding to the second user, a subset of one or more second fulfillment actions from the set of fulfillment actions, wherein the second user is an additional user that is in addition to the first user and wherein the subset of one or more second fulfillment actions is associated with controlling at least a second component of the vehicle that is not controlled when the subset of the one or more first fulfilment actions is implemented;
and
cause the one or more second fulfillment actions to be implemented to satisfy the given spoken utterance.

12 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/692,743Filed 11 Mar 2022
Published: US 2023/0290359 A114 Sep 2023
Granted: 15 Oct 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G10L 17/22
Speaker identification or verification techniques: interactive procedures; Man-machine interfaces
B60R 16/0373
For occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel: voice control
G06V 40/172
Human faces, e.g. facial parts, sketches or expressions: classification, e.g. identification
G10L 17/06
Speaker identification or verification techniques: decision making techniques; Pattern matching strategies

Family

US 2023/0290359 A1Pre-grant publication · published 14 Sep 2023
US 12,154,575 B2Related patent
US 12,119,007 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key