US 2022/0189465 A1Published application

Speaker Dependent Follow Up Actions And Warm Words

AssigneeGoogle Inc.

InventorsMatthew Sharifi, Victor Carbune

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method includes receiving audio data corresponding to an utterance spoken by a user that includes a command for a digital assistant to perform a long-standing operation, activating a set of one or more warm words associated with a respective action for controlling the long-standing operation, and associating the activated set of one or more warm words with only the user. While the digital assistant is performing the long-standing operation, the method includes receiving additional audio data corresponding to an additional utterance, identifying one of the warm words from the activated set of warm words, and performing speaker verification on the additional audio data. The method further includes performing the respective action associated with the identified one of the warm words for controlling the long-standing operation when the additional utterance was spoken by the same user that is associated with the activated set of one or more warm words.

Claims28

Dependent claims

A method for activating speaker-dependent warm words, the method comprising:

receiving, at data processing hardware, audio data corresponding to an utterance spoken by a user and captured by an assistant-enabled device associated with the user, the utterance comprising a command for a digital assistant to perform a long-standing operation;
after receiving the audio data corresponding to the utterance:
activating, by the data processing hardware, a set of one or more warm words each associated with a respective action for controlling the long-standing operation;
and
associating, by data processing hardware, the activated set of one or more warm words with only the user that spoke the utterance;
and
while the digital assistant is performing the long-standing operation:
receiving, at the data processing hardware, additional audio data corresponding to an additional utterance captured by the assistant-enabled device;
identifying, by the data processing hardware, in the additional audio data, one of the warm words from the activated set of one or more warm words;
performing, by the data processing hardware, speaker verification on the additional audio data to determine whether the additional utterance was spoken by the same user that is associated with the activated set of one or more warm words;
and
when the additional utterance was spoken by the same user that is associated with the activated set of one or more warm words, performing, by data processing hardware, the respective action associated with the identified one of the warm words for controlling the long-standing operation.

9 more elements

A system comprising:

data processing hardware;
and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
receiving audio data corresponding to an utterance spoken by a user and captured by an assistant-enabled device associated with the user, the utterance comprising a command for a digital assistant to perform a long-standing operation;
after receiving the audio data corresponding to the utterance:
activating a set of one or more warm words each associated with a respective action for controlling the long-standing operation;
and
associating the activated set of one or more warm words with only the user that spoke the utterance;
and
while the digital assistant is performing the long-standing operation:
receiving additional audio data corresponding to an additional utterance captured by the assistant-enabled device;
identifying in the additional audio data, one of the warm words from the activated set of one or more warm words;
performing speaker verification on the additional audio data to determine whether the additional utterance was spoken by the same user that is associated with the activated set of one or more warm words;
and
when the additional utterance was spoken by the same user that is associated with the activated set of one or more warm words, performing the respective action associated with the identified one of the warm words for controlling the long-standing operation.

12 more elements

Dependencies are inferred from the claim text.