US 2022/0093101 A1 · DIALOG MANAGEMENT FOR MULTIPLE USERS

Abstract

A system that is capable of resolving anaphora using timing data received by a local device. A local device outputs audio representing a list of entries. The audio may represent synthesized speech of the list of entries. A user can interrupt the device to select an entry in the list, such as by saying “that one.” The local device can determine an offset time representing the time between when audio playback began and when the user interrupted. The local device sends the offset time and audio data representing the utterance to a speech processing system which can then use the offset time and stored data to identify which entry on the list was most recently output by the local device when the user interrupted. The system can then resolve anaphora to match that entry and can perform additional processing based on the referred to item.

Claims20

Dependent claims

A computer-implemented method comprising:

receiving output audio data representing synthesized speech of a list of entries;
beginning playback of audio corresponding to the output audio data;
during the playback of the audio, detecting user speech;
determining input audio data representing the user speech;
determining a first time corresponding to the beginning of the playback;
determining a second time corresponding to the detecting the user speech;
determining offset time data representing a difference between the first time and the second time;
performing speech processing on the input audio data to determine the user speech refers to an entry that is absent from the user speech;
processing the offset time data to determine the entry is a first entry in the list of entries;
and
causing an action to be performed based at least in part on the first entry.

8 more elements

A computing system comprising:

at least one processor;
and
at least one memory comprising instructions that, when executed by the at least one processor, cause the computing system to:
receive, from a user device, input audio data representing an utterance;
receive, from the user device, time data representing timing of the utterance relative to audio being output by the user device;
perform processing using the input audio data and the time data to determine a first selection referred to in the utterance;
and
cause an action to be performed based at least in part on the selection.

5 more elements

Dependencies are inferred from the claim text.

Dialog management for multiple users

Life of this patent

Dialog management for multiple users

Life of this patent

Abstract

Claims20