# US 2020/0395015 A1 · Voice Detection By Multiple Devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0395015 A1
- Document ID: US20200395015A1
- Status: Published application
- Kind: A1
- Application number: 16/915,234
- Filed: 2020-06-29
- Published: 2020-12-17
- Earliest claimed: 2016-07-15
- Assignees: Sonos, Inc.
- Applicants: Sonos, Inc.
- Inventors: Jonathon Reilly; Gregory Burlingame; Christopher Butts; Romi Kadri; Jonathan P. Lang
- Web page: https://patentgrep.com/patent/US20200395015A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G10L 15/34: Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are example techniques for voice detection by multiple NMDs. An example implementation may involve one or more servers receiving, via a network interface, data representing multiple audio recordings of a voice input spoken by a given user, each audio recording recorded by a respective NMD of the multiple NMDs, wherein the voice input comprises a detected wake-word. Based on respective sound pressure levels of the multiple audio recordings of the voice input, the servers (i) select a particular NMD of the multiple NMDs and (ii) forego selection of other NMDs of the multiple NMDs. The servers send, via the network interface to the particular NMD, data representing a playback command that corresponds to a voice command in the voice input represented in the multiple audio recordings, wherein the data representing the playback command causes the particular NMD to play back audio content according to the playback command.

## Claims

### Claim 1

A system comprising a first network microphone device (NMD) and a second NMD, the system configured to perform functions comprising:
detecting, via one or more microphones of the first NMD, first voice data representing a first portion of a voice input;
detecting, via one or more microphones of the second NMD, second voice data representing the first portion of the voice input;
based on (i) one or more characteristics of the first voice data and (ii) one or more characteristics of the second voice data, selecting the first voice data from among (a) the first voice data and (b) the second voice data;
processing, via one or more processors of the first NMD, the selected first voice data to determine a voice command;
detecting, via one or more microphones of the first NMD, third voice data representing a second portion of the voice input;
detecting, via one or more microphones of the second NMD, fourth voice data representing the second portion of the voice input;
based on (i) one or more characteristics of the third voice data and (ii) one or more characteristics of the fourth voice data, selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data;
processing, via one or more processors of the second NMD, the selected fourth voice data to determine the voice command; and
causing one or more devices to carry out the determined voice command.

### Claim 2 (depends on 1)

The system of claim 1, wherein the one or more characteristics of the first voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the second voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the first voice data from among (a) the first voice data and (b) the second voice data comprises determining that the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD are greater than then the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more characteristics of the third voice data comprise sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the fourth voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data comprises determining that the sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD are less than a threshold level.

### Claim 4 (depends on 1)

The system of claim 1, wherein the functions further comprise:
sending, via a network interface of the first NMD, instructions to cause the second NMD to start recording the voice input via the one or more microphones of the second NMD.

### Claim 5 (depends on 1)

The system of claim 1, wherein selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data comprises:
sending, via a network interface of the first NMD, instructions to cause the second NMD to process the second portion of the voice input.

### Claim 6 (depends on 1)

The system of claim 1, wherein detecting, via one or more microphones of the first NMD, first voice data representing the first portion of the voice input comprises:
detecting a wake word in the first voice data.

### Claim 7 (depends on 1)

The system of claim 1, wherein the first NMD is associated with a first room in a household, and wherein the second NMD is associated with a second room in the household.

### Claim 8 (depends on 1)

The system of claim 1, wherein a first playback device comprises the first NMD, wherein a second playback device comprises the second NMD, and wherein the first playback device and the second playback device are configured in a bonded zone of a media playback system that comprises the first playback device and the second playback device.

### Claim 9 (depends on 1)

The system of claim 1, wherein the first portion of the voice input and the second portion of the voice input at least partially overlap.

### Claim 10

A method comprising:
detecting, via one or more microphones of a first network microphone device (NMD), first voice data representing a first portion of a voice input;
detecting, via one or more microphones of a second NMD, second voice data representing the first portion of the voice input;
based on (i) one or more characteristics of the first voice data and (ii) one or more characteristics of the second voice data, selecting the first voice data from among (a) the first voice data and (b) the second voice data;
processing, via one or more processors of the first NMD, the selected first voice data to determine a voice command;
detecting, via one or more microphones of the first NMD, third voice data representing a second portion of the voice input;
detecting, via one or more microphones of the second NMD, fourth voice data representing the second portion of the voice input;
based on (i) one or more characteristics of the third voice data and (ii) one or more characteristics of the fourth voice data, selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data;
processing, via one or more processors of the second NMD, the selected fourth voice data to determine the voice command; and
causing one or more devices to carry out the determined voice command.

### Claim 11 (depends on 10)

The method of claim 10, wherein the one or more characteristics of the first voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the second voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the first voice data from among (a) the first voice data and (b) the second voice data comprises determining that the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD are greater than then the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD.

### Claim 12 (depends on 10)

The method of claim 10, wherein the one or more characteristics of the third voice data comprise sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the fourth voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data comprises determining that the sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD are less than a threshold level.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
sending, via a network interface of the first NMD, instructions to cause the second NMD to start recording the voice input via the one or more microphones of the second NMD.

### Claim 14 (depends on 10)

The method of claim 10, wherein selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data comprises:
sending, via a network interface of the first NMD, instructions to cause the second NMD to process the second portion of the voice input.

### Claim 15 (depends on 10)

The method of claim 10, wherein detecting, via one or more microphones of the first NMD, first voice data representing the first portion of the voice input comprises:
detecting a wake word in the first voice data.

### Claim 16 (depends on 10)

The method of claim 10, wherein a first playback device comprises the first NMD, wherein a second playback device comprises the second NMD, and wherein the first playback device and the second playback device are configured in a bonded zone of a media playback system that comprises the first playback device and the second playback device.

### Claim 17 (depends on 10)

The method of claim 10, wherein the first portion of the voice input and the second portion of the voice input at least partially overlap.

### Claim 18

A tangible, non-transitory, computer-readable media having instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a system to perform functions comprising:
detecting, via one or more microphones of a first network microphone device (NMD), first voice data representing a first portion of a voice input;
detecting, via one or more microphones of a second NMD, second voice data representing the first portion of the voice input;
based on (i) one or more characteristics of the first voice data and (ii) one or more characteristics of the second voice data, selecting the first voice data from among (a) the first voice data and (b) the second voice data;
processing, via one or more processors of the first NMD, the selected first voice data to determine a voice command;
detecting, via one or more microphones of the first NMD, third voice data representing a second portion of the voice input;
detecting, via one or more microphones of the second NMD, fourth voice data representing the second portion of the voice input;
based on (i) one or more characteristics of the third voice data and (ii) one or more characteristics of the fourth voice data, selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data;
processing, via one or more processors of the second NMD, the selected fourth voice data to determine the voice command; and
causing one or more devices to carry out the determined voice command.

### Claim 19 (depends on 18)

The tangible, non-transitory, computer-readable media of claim 18, wherein the one or more characteristics of the first voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the second voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the first voice data from among (a) the first voice data and (b) the second voice data comprises determining that the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the first NMD are greater than then the sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD.

### Claim 20 (depends on 18)

The tangible, non-transitory, computer-readable media of claim 18, wherein the one or more characteristics of the third voice data comprise sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD, wherein the one or more characteristics of the fourth voice data comprise sound pressure levels of the first portion of the voice input as detected by the one or more microphones of the second NMD, and wherein selecting the fourth voice data from among (a) the third voice data and (b) the fourth voice data comprises determining that the sound pressure levels of the second portion of the voice input as detected by the one or more microphones of the first NMD are less than a threshold level.
