US 2022/0189471 A1Published application

Combining Device or Assistant-Specific Hotwords in a Single Utterance

AssigneeGoogle Inc.

InventorsMATTHEW SHARIFI, Victor Carbune

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method for combining hotwords in a single utterance receives, at a first assistant-enabled device (AED), audio data corresponding to an utterance directed toward the first AED and a second AED among two or more AEDs where the audio data includes a query specifying an operation to perform. The method also detects, using a hotword detector, a first hotword assigned to the first AED that is different than a second hotword assigned to the second AED In response to detecting the first hotword, the method initiates processing on the audio data to determine that the audio data includes a term preceding the query that at least partially matches the second hotword assigned. Based on the at least partial match, the method executes a collaboration routine to cause the first AED and the second AED to collaborate with one another to fulfill the query.

Claims24

Dependent claims

A method comprising:

receiving, at data processing hardware of a first assistant-enabled device (AED), audio data corresponding to an utterance spoken by the user and directed toward the first AED and a second AED among two or more AEDs associated with the user, the audio data comprising a query specifying an operation to perform;
detecting, by the data processing hardware, using a hotword detection model, a first hotword in the audio data, the first hotword assigned to the first AED and different than a second hotword assigned to the second AED;
in response to detecting the first hotword assigned to the first AED in the audio data, initiating, by the data processing hardware, processing on the audio data to determine that the audio data comprises one or more terms preceding the query that at least partially match the second hotword assigned to the second AED;
and
based on the determination that the audio data comprises the one or more terms preceding the query that at least partially match the second hotword, executing, by the data processing hardware, a collaboration routine to cause the first AED and the second AED to collaborate with one another to fulfill performance of the operation specified by the query.

2 more elements

A first assistant-enabled (AED) device comprising:

data processing hardware;
and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
receiving audio data corresponding to an utterance spoken by the user and directed toward the first AED and a second AED among two or more AEDs associated with the user, the audio data comprising a query specifying an operation to perform;
detecting, using a hotword detection model, a first hotword in the audio data, the first hotword assigned to the first AED and different than a second hotword assigned to the second AED;
in response to detecting the first hotword assigned to the first AED in the audio data, initiating processing on the audio data to determine that the audio data comprises one or more terms preceding the query that at least partially match the second hotword assigned to the second AED;
and
based on the determination that the audio data comprises the one or more terms preceding the query that at least partially match the second hotword, executing a collaboration routine to cause the first AED and the second AED to collaborate with one another to fulfill performance of the operation specified by the query.

5 more elements

Dependencies are inferred from the claim text.