# US 2023/0410812 A1 · Systems and methods for selective wake word detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410812 A1
- Document ID: US20230410812A1
- Status: Published application
- Kind: A1
- Application number: 18/459,982
- Filed: 2023-09-01
- Published: 2023-12-21
- Earliest claimed: 2018-09-28
- Assignees: Sonos, Inc.
- Applicants: Sonos, Inc.
- Inventors: Joachim Fainberg; Daniele Giacobello; Klaus Hartung
- Web page: https://patentgrep.com/patent/US20230410812A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/14: using statistical models, e.g. Hidden Markov Models [HMMs] (G10L15/18 takes precedence)
- G10L 15/16: using artificial neural networks
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods for media playback via a media playback system include capturing sound data via a network microphone device and identifying a candidate wake word in the sound data. Based on identification of the candidate wake word in the sound data, the system selects a first wake-word engine from a plurality of wake-word engines. Via the first wake-word engine, the system analyzes the sound data to detect a confirmed wake word, and, in response to detecting the confirmed wake word, transmits a voice utterance of the sound data to one or more remote computing devices associated with a voice assistant service.

## Claims

### Claim 1

A network microphone device, comprising:
one or more processors;
one or more microphones; and
data storage having instructions stored thereon that, when executed by the one or more processors, cause the network microphone device to perform operations comprising:
capturing sound data via the one or more microphones;
identifying, using a keyword spotting algorithm, a candidate wake word in the sound data;
based on identification of the candidate wake word in the sound data via the keyword spotting algorithm, selecting a first wake-word detection algorithm from among a plurality of wake-word detection algorithms stored on the network microphone device, wherein the first wake-word detection algorithm is associated with a first voice assistant service and another of the plurality of wake-word detection algorithms is associated with a second voice assistant service different from the first;
after selecting the first wake-word detection algorithm, and without using another of the plurality of wake-word detection algorithms, using the first wake-word detection algorithm to analyze the sound data to confirm detection of the candidate wake word identified via the keyword spotting algorithm, wherein the first wake-word detection algorithm is configured to determine whether the candidate wake word is present in the sound data with a higher accuracy than the keyword spotting algorithm; and
in response to confirming the detection of the candidate wake word, processing a voice utterance of the sound data to determine an intent.

### Claim 2 (depends on 1)

The network microphone device of claim 1, wherein processing the voice utterance comprises transmitting the voice utterance to one or more remote computing devices associated with the first voice assistant service.

### Claim 3 (depends on 1)

The network microphone device of claim 1, wherein processing the voice utterance is performed locally.

### Claim 4 (depends on 1)

The network microphone device of claim 1, wherein analyzing the sound data to confirm detection of the candidate wake word using the using the first wake-word detection algorithm, and without using another of the wake-word detection algorithms comprises:
activating a first wake-word engine to process the sound data using the first wake-word detection algorithm while a second wake-word engine configured to process the sound data using another of the wake-word detection algorithms is in an inactive state.

### Claim 5 (depends on 1)

The network microphone device of claim 1, wherein identifying the candidate wake word comprises applying a neural network model to the sound data.

### Claim 6 (depends on 1)

The network microphone device of claim 1, further comprising, after processing the voice utterance, receiving, via the network microphone device, a selection of media content related to the voice utterance.

### Claim 7 (depends on 1)

The network microphone device of claim 1, wherein the plurality of wake-word detection algorithms comprises:
the first wake-word detection algorithm; and
a second wake-word detection algorithm configured to perform a local function of the network microphone device.

### Claim 8

A method comprising:
capturing sound data via a network microphone device;
identifying, using a keyword spotting algorithm, a candidate wake word in the sound data;
based on identification of the candidate wake word in the sound data via the keyword spotting algorithm, selecting a first wake-word detection algorithm from among a plurality of wake-word detection algorithms stored on the network microphone device, wherein the first wake-word detection algorithm is associated with a first voice assistant service and another of the plurality of wake-word detection algorithms is associated with a second voice assistant service different from the first;
after selecting the first wake-word detection algorithm, and without using another of the plurality of wake-word detection algorithms, using the first wake-word detection algorithm to analyze the sound data to confirm detection of the candidate wake word identified via the keyword spotting algorithm, wherein the first wake-word detection algorithm is configured to determine whether the candidate wake word is present in the sound data with a higher accuracy than the keyword spotting algorithm; and
in response to confirming the detection of the candidate wake word, processing a voice utterance of the sound data to determine an intent.

### Claim 9 (depends on 8)

The method of claim 8, wherein processing the voice utterance comprises transmitting the voice utterance to one or more remote computing devices associated with the first voice assistant service.

### Claim 10 (depends on 8)

The method of claim 8, wherein processing the voice utterance is performed locally.

### Claim 11 (depends on 8)

The method of claim 8, wherein analyzing the sound data to confirm detection of the candidate wake word using the first wake-word detection algorithm, and without using another of the wake-word detection algorithms comprises:
activating a first wake-word engine to process the sound data using the first wake-word detection algorithm while a second wake-word engine configured to process the sound data using another of the wake-word detection algorithms is in an inactive state.

### Claim 12 (depends on 8)

The method of claim 8, wherein identifying the candidate wake word comprises applying a neural network model to the sound data.

### Claim 13 (depends on 8)

The method of claim 8, further comprising, after processing the voice utterance, receiving, via the network microphone device, a selection of media content related to the voice utterance.

### Claim 14 (depends on 8)

The method of claim 8, wherein the plurality of wake-word detection algorithms comprises:
the first wake-word detection algorithm; and
a second wake-word detection algorithm configured to perform a local function of the network microphone device.

### Claim 15

One or more tangible, non-transitory, computer-readable media storing instructions executable by one or more processors to cause a network microphone device to perform operations comprising:
capturing sound data via the network microphone device;
identifying, using a keyword spotting algorithm, a candidate wake word in the sound data;
based on identification of the candidate wake word in the sound data via the keyword spotting algorithm, selecting a first wake-word detection algorithm from among a plurality of wake-word detection algorithms stored on the network microphone device, wherein the first wake-word detection algorithm is associated with a first voice assistant service and another of the plurality of wake-word detection algorithms is associated with a second voice assistant service different from the first;
after selecting the first wake-word detection algorithm, and without using another of the plurality of wake-word detection algorithms, using the first wake-word detection algorithm to analyze the sound data to confirm detection of the candidate wake word identified via the keyword spotting algorithm, wherein the first wake-word detection algorithm is configured to determine whether the candidate wake word is present in the sound data with a higher accuracy than the keyword spotting algorithm; and
in response to confirming the detection of the candidate wake word, processing a voice utterance of the sound data to determine an intent.

### Claim 16 (depends on 15)

The computer-readable media of claim 15, wherein processing the voice utterance comprises transmitting the voice utterance to one or more remote computing devices associated with the first voice assistant service.

### Claim 17 (depends on 15)

The computer-readable media of claim 15, wherein processing the voice utterance is performed locally.

### Claim 18 (depends on 15)

The computer-readable media of claim 15, wherein analyzing the sound data to confirm detection of the candidate wake word using the using the first wake-word detection algorithm, and without using another of the wake-word detection algorithms comprises:
activating a first wake-word engine to process the sound data using the first wake-word detection algorithm while a second wake-word engine configured to process the sound data using another of the wake-word detection algorithms is in an inactive state.

### Claim 19 (depends on 15)

The computer-readable media of claim 15, wherein identifying the candidate wake word comprises applying a neural network model to the sound data.

### Claim 20 (depends on 15)

The computer-readable media of claim 15, wherein the plurality of wake-word detection algorithms comprises:
the first wake-word detection algorithm; and
a second wake-word detection algorithm configured to perform a local function of the network microphone device.
