US 11,893,308 B2Granted

Media playback system with concurrent voice assistance

AssigneeSonos, Inc.

InventorsDayn Wilberding, John Tolomei

Life of this patent

Estimating the term…

Loading patent…

Abstract

Example techniques involve invoking voice assistance for a media playback system. In some embodiments, a NMD stores in memory a set of command information comprising a listing of playback commands and associated command criteria. The NMD captures a voice input and detects inclusion, within the voice input, of one or more particular playback commands from among the playback commands in the listing. In response, the NMD selects a local voice assistant that supports (a) one or more additional playback commands relative to a cloud-based VAS and (b) fewer non-playback commands relative to the cloud-based VAS, determines, via the local voice assistant, an intent in the captured voice input, and performs a response to the determined intent. The NMD foregoes selection of the cloud-based VAS when the local voice assistant is selected.

Claims20

Dependent claims

A playback device comprising:

at least one audio transducer;
at least one microphone;
a network interface;
at least one processor;
and
data storage including instructions that are executable by the at least one processor such that the playback device is configured to:
capture a voice input via the at least one microphone, wherein capturing the voice input comprises buffering first voice data;
determine, via a first voice assistant that is capable of processing a set of first keywords, that additional voice input is required to process the voice input, wherein the voice input comprises at least one first keyword;
output, via the at least one audio transducer;
an audio prompt for the additional voice input;
capture the additional voice input via the at least one microphone, wherein capturing the additional voice input comprises buffering second voice data;
process, via the first voice assistant, the voice input in combination with the additional voice input;
determine that the first voice assistant is unable to process the voice input with the additional voice input, wherein the additional voice input includes at least one second keyword, and wherein the set of first keywords is exclusive of the at least one second keyword;
and
send, via the network interface to a second voice assistant that is capable of processing a set of second keywords, a query corresponding to the voice input for processing, wherein the set of second keywords includes more keywords than the set of first keywords.

12 more elements

A system comprising a playback device and a computing system, the playback device comprising:

at least one audio transducer;
at least one microphone;
a first network interface;
at least one first processor;
first data storage including instructions that, when executed by the at least one first processor, cause the playback device to perform first functions comprising:
capturing a voice input via the at least one microphone, wherein capturing the voice input comprises buffering first voice data;
determining, via a first voice assistant that is capable of processing a set of first keywords, that additional voice input is required to process the voice input, wherein the voice input comprises at least one first keyword;
outputting, via the at least one audio transducer;
an audio prompt for the additional voice input;
capturing the additional voice input via the at least one microphone, wherein capturing the additional voice input comprises buffering second voice data;
processing, via the first voice assistant, the voice input in combination with the additional voice input, wherein the additional voice input includes at least one second keyword, and wherein the set of first keywords is exclusive of the at least one second keyword;
determining that the first voice assistant is unable to process the voice input with the additional voice input;
and
sending, via the network interface to a second voice assistant that is capable of processing a set of second keywords, a query corresponding to the voice input for processing, wherein the set of second keywords includes more keywords than the set of first keywords;
and
the computing system comprising:
a second network interface;
at least one second processor;
and
second data storage including instructions that, when executed by the at least one second processor, cause the computing system to perform second functions comprising:
receiving, via the second network interface, the query corresponding to the voice input;
and
sending, via the second network interface, a response corresponding to the query.

20 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/656,794Filed 28 Mar 2022 · continuation
Priority: 29 Sep 2017
Published: US 2022/0222039 A114 Jul 2022
Granted: 6 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification17 codes

G06F 3/167
Sound input; Sound output: audio in a user interface, e.g. using voice commands for navigating, audio feedback
G06F 3/04817
Based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like…:…
G10L 15/08
Speech recognition: speech classification or search
G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue

Family

Application15/721,141Parent of this continuation · filed 29 Sep 2017
Application16/672,764Parent of this continuation · filed 4 Nov 2019
US 10,466,962 B2Parent of this continuation · filed 5 Nov 2019
Application16/834,483Parent of this continuation · filed 30 Mar 2020
US 10,606,555 B1Parent of this continuation · filed 31 Mar 2020
US 2022/0222039 A1Pre-grant publication · published 14 Jul 2022
US 11,288,039 B2Parent of this continuation
US 2019/0102145 A1Published application
US 2020/0089469 A1Published application
US 2020/0326909 A1Published application
US 11,893,308 B2This patent

From the US filing history. Foreign family members aren’t listed.