US 2022/0093093 A1 · DIALOG MANAGEMENT FOR MULTIPLE USERS

Abstract

A system can operate a speech-controlled device in a mode where the speech-controlled device determines that an utterance is directed at the speech-controlled device using image data showing the user speaking the utterance. If the user is directing the user's gaze at the speech-controlled device while speaking, the system may determine the utterance is system directed and thus may perform further speech processing based on the utterance. If the user's gaze is directed elsewhere, the system may determine the utterance is not system directed (for example directed at another user) and thus the system may not perform further speech processing based on the utterance and may take other actions, for example discarding audio data of the utterance.

Claims19

Dependent claims

A computer-implemented method comprising:

receiving, from a user device operating in a first mode, first input audio data representing a first utterance initiated by a wakeword;
processing the first utterance to determine a command to operate the user device in a second mode;
sending, to the user device, a command to operate in the second mode;
beginning operation in the second mode;
using at least one microphone, generating second input audio data representing a second utterance, the second utterance spoken by a user;
using at least one camera, generating image data representing the user, the image data indicating that the user is looking at the user device while speaking the second utterance;
using the image data to determine that the second utterance is directed at the user device;
and
in response to using the image data to determine that the second utterance is directed at the user device, sending the second input audio data for speech processing to be performed.

6 more elements

Dependencies are inferred from the claim text.

Dialog management for multiple users

Life of this patent

Dialog management for multiple users

Life of this patent

Abstract

Claims19