US 10,685,669 B1Granted

Device selection from audio data

AssigneeAmazon Technologies, Inc.

InventorsGang Lan, Joseph Pedro Tavares, Deepak Uttam Shah, Mckay Clawson, Vijay Shankar Tennety, Ravi Kiran Rachakonda, Venkata Snehith Cherukuri, Charles James Torbert

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

This disclosure describes techniques for identifying a voice-enabled device from a group of voice-enabled devices to respond to a speech utterance of a user. A speech-processing system may receive an audio signal representing the speech utterance captured in an environment of a voice-enabled device, and identify another voice-enabled device located in the environment. The system may analyze the audio signal using a different natural-language-understanding model for each of the voice-enabled devices to identify an intent for each of the voice-enabled devices to respond to the speech utterance. The system may determine confidence scores that the intents are responsive to the speech utterance, and select the intent with the highest confidence score. The system may use the selected intent to generate a command for the corresponding voice-enabled device to respond to the user.

Claims20

Dependent claims

A system comprising:

one or more processors;
computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, from a first voice-enabled device, audio data representing a speech utterance;
generating, using automatic speech recognition (ASR) processing and the audio data, text data representing the speech utterance;
determining a first device profile of the first voice-enabled device;
determining the first voice-enabled device and a second voice-enabled device are located in a same physical environment;
determining a second device profile of the second voice-enabled device;
determining, using a first natural-language-understanding (NLU) model and the text data, first intent data representing the speech utterance, wherein the first NLU model is associated with the first device profile;
determining, using a second NLU model and the text data, second intent data representing the speech utterance, wherein the second NLU model is associated with the second device profile;
determining a first confidence score that the speech utterance corresponds to the first intent data;
determining a second confidence score that the speech utterance corresponds to the second intent data;
determining that the second confidence score is greater than the first confidence score;
based at least in part on the second confidence score being greater than the first confidence score, using the second intent data to determine a command to cause the second voice-enabled device to perform an action;
and
sending, to the second voice-enabled device, command data indicating the command.

12 more elements

A method comprising:

receiving audio data from a first device in an environment, the audio data representing a speech utterance;
generating, using automatic speech recognition (ASR) processing and the audio data, text data representing the speech utterance;
determining that a second device is in the environment;
determining, using a first natural-language-understanding (NLU) model and the text data, first intent data representing the speech utterance, wherein the first NLU model is associated with the first device;
determining, using a second NLU model and the text data, second intent data representing the speech utterance, wherein the second NLU model is associated with the second device;
selecting the second intent data instead of the first intent data;
using the second intent data to determine a command to cause the second device to perform an action;
and
sending, to the second device, command data indicating the command.

6 more elements

A system comprising:

one or more processors;
computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, from a first device, audio data representing a speech utterance;
generating, using automatic speech recognition (ASR) processing and the audio data, text data representing the speech utterance;
determining, using a first natural-language-understanding (NLU) model and the text data, first intent data representing the speech utterance, wherein the first NLU model is associated with the first device;
determining, using a second NLU model and the text data, second intent data representing the speech utterance, wherein the second NLU model is associated with a second device;
selecting the first intent data instead of the second intent data;
using the first intent data to determine a command to cause the first device to perform an action;
and
sending, to the first device, command data indicating the command.

7 more elements

Dependencies are inferred from the claim text.