US 11,538,478 B2 · Multiple virtual assistants

Abstract

A speech-processing system may provide access to multiple virtual assistants via one or more voice-controlled devices. Each assistant may leverage language processing and language generation features of the speech-processing system, while handling different commands and/or providing access to different back applications. Different assistants may be available for use with a particular voice-controlled device based on time, location, the particular user, etc. The voice-controlled device may include components for facilitating user interaction with multiple assistants. For example, a multi-assistant component may facilitate enabling/disabling assistants, assigning gestures and/or wakewords, etc. The multi-assistant component may handle routing commands to a command processing subsystem corresponding to an assistant invoked by the command. The voice controlled device may further include observer components, each configured to monitor the voice-controlled device for invocations of a particular assistant.

Claims20

Dependent claims

A method comprising:

detecting, by a device, a first gesture, wherein the first gesture is a non-verbal movement detectable by the device;
receiving, by a microphone of the device, first input audio representing a spoken utterance;
determining, using data stored by the device, that the first gesture corresponds to a first command processing subsystem (CPS), wherein the data stored by the device indicates that the first gesture represents a request to invoke the first CPS and that a second gesture represents a request to invoke a second CPS;
outputting, by the device, a first indication that the first CPS is processing the first input audio;
in response to determining that the first gesture corresponds to the first CPS, sending, by the device to a speech-processing system, first data representing the first input audio and a second indication that the first data is to be processed by the first CPS, the speech-processing system capable of sending input data to the first CPS and the second CPS;
receiving, from the speech-processing system, first response data;
and
outputting, by the device, first synthesized speech in a first speech style corresponding to the first CPS.

5 more elements

A method comprising:

receiving, by a device, first input audio representing a spoken utterance;
detecting, by the device, a first wake command;
determining, using data stored by the device, that the first wake command corresponds to a first command processing subsystem (CPS), wherein the data stored by the device indicates that the first wake command represents a request to invoke the first CPS and that a second wake command represents a request to invoke a second CPS;
in response to determining that the first wake command corresponds to the first CPS, sending, by the device to a speech-processing system, first data representing the first input audio and a first indication that the first data is to be processed by the first CPS, the speech-processing system capable of sending input data to at least the first CPS and the second CPS;
receiving, from the speech-processing system, first response data;
and
performing, by the device, a first action based on the first response data.

4 more elements

A device, comprising:

at least one processor;
and
at least one memory comprising instructions that, when executed by the at least one processor, cause the device to:
receive first input audio representing a spoken utterance;
detect a first wake command;
determine, using data stored by the device, that the first wake command corresponds to a first command processing subsystem (CPS), wherein the data stored by the device indicates that the first wake command represents a request to invoke the first CPS and that a second wake command represents a request to invoke a second CPS;
in response to determining that the first wake command corresponds to the first CPS, send, to a speech-processing system, first data representing the first input audio and a first indication that the first data is to be processed by the first CPS, the speech-processing system capable of sending input data to at least the first CPS and the second CPS;
receive, from the speech-processing system, first response data;
and
perform a first action based on the first response data.

7 more elements

Dependencies are inferred from the claim text.

Multiple virtual assistants

Life of this patent

Multiple virtual assistants

Life of this patent

Abstract

Claims20