# US 10,482,878 B2 · System and method for speech enhancement in multisource environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,482,878 B2
- Document ID: US10482878B2
- Status: Granted
- Kind: B2
- Application number: 15/831,808
- Filed: 2017-12-05
- Published: 2019-05-30
- Granted: 2019-11-19
- Earliest claimed: 2017-11-29
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: Tobias Wolff; Jan Philip Janssen; Simon Graf; Tim Haulick
- Web page: https://patentgrep.com/patent/US10482878B2

## CPC

- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G01S 3/8006: {Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals}
- G10L 15/183: using context dependencies, e.g. language models
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 21/028: using properties of sound source
- G10L 2015/088: {Word spotting}
- G10L 2021/02166: {Microphone arrays; Beamforming}
- H04R 1/406: {microphones}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 2201/401: 2D or 3D arrays of transducers
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A method, computer program product, and computer system for receiving, by a computing device, a first signal emitted from one or more sources. A second signal may be received emitted from the one or more sources. A first confidence level that the wake-up-word is included in the first signal may be determined. A second confidence level that the wake-up-word is included in the second signal may be determined. It may be identified that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels. The first source may be enabled to participate in a dialog phase.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by a computing device, a first signal emitted from one or more sources;
receiving a second signal emitted from the one or more sources;
determining a first confidence level that a wake-up-word is included in the first signal;
determining a second confidence level that the wake-up-word is included in the second signal;
identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and
enabling the first source to participate in a dialogue phase.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1 further comprising excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1 further comprising tracking movement of the first source with at least one of one or more core localizers.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1 wherein the first signal and the second signal are received at a microphone group.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1 further comprising determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1 further comprising extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference.

### Claim 9

A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising: receiving a first signal emitted from one or more sources; receiving a second signal emitted from the one or more sources; determining a first confidence level that a wake-up-word is included in the first signal; determining a second confidence level that the wake-up-word is included in the second signal; identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and enabling the first source to participate in a dialogue phase.

### Claim 10 (depends on 9)

The computer program product of claim 9 further comprising excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

### Claim 11 (depends on 9)

The computer program product of claim 9 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

### Claim 12 (depends on 9)

The computer program product of claim 9 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

### Claim 13 (depends on 9)

The computer program product of claim 9 wherein the operations further comprise tracking movement of the first source with at least one of one or more core localizers.

### Claim 14 (depends on 9)

The computer program product of claim 9 wherein the operations further comprise extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference.

### Claim 15 (depends on 9)

The computer program product of claim 9 wherein the operations further comprise determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.

### Claim 16

A computing system including one or more processors and one or more computer readable media having a plurality of instructions stored thereon which, when executed across the one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
receiving a first signal emitted from one or more sources;
receiving a second signal emitted from the one or more sources;
determining a first confidence level that a wake-up-word is included in the first signal;
determining a second confidence level that the wake-up-word is included in the second signal;
identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and
enabling the first source to participate in a dialogue phase.

### Claim 17 (depends on 16)

The computing system of claim 16 wherein the operations further comprise excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

### Claim 18 (depends on 16)

The computing system of claim 16 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

### Claim 19 (depends on 16)

The computing system of claim 16 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

### Claim 20 (depends on 16)

The computing system of claim 16 wherein the operations further comprise at least one of extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference and determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.
