# US 2015/0149162 A1 · Multi-channel speech recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0149162 A1
- Document ID: US20150149162A1
- Status: Published application
- Kind: A1
- Application number: 14/087,885
- Filed: 2013-11-22
- Published: 2015-05-28
- Earliest claimed: 2013-11-22
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: AT&T Intellectual Property I, L.P.
- Inventors: Ilya Dan MELAMED; Andrej LJOLJE
- Web page: https://patentgrep.com/patent/US20150149162A1

## CPC

- G10L 15/07: to the speaker
- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G10L 15/28: Constructional details of speech recognition systems
- G10L 2015/227: {of the speaker; Human-factor methodology}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Disclosed herein are systems, methods, and computer-readable storage devices for performing per-channel automatic speech recognition. An example system configured to practice the method combines a first audio signal of a first speaker in a communication session and a second audio signal from a second speaker in the communication session as a first audio channel and a second audio channel. The system can recognize speech in the first audio channel of the recording using a first model associated with the first speaker, and recognize speech in the second audio channel of the recording using a second model associated with the second speaker, wherein the first model is different from the second model. The system can generate recognized speech as an output from the communication session. The system can identify the models based on identifiers of the speakers, such as a telephone number, an IP address, a customer number, or account number.

## Claims

### Claim 1

A method comprising:
combining, via a processor, a first audio signal of a first speaker in a communication session and a second audio signal from a second speaker in the communication session as a first audio channel and a second audio channel, to yield a recording of the communication session;
recognizing speech in the first audio channel of the recording using a first model associated with the first speaker; and
recognizing speech in the second audio channel of the recording using a second model associated with the second speaker, wherein the first model is different from the second model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating recognized speech as an output from the communication session.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
identifying the first model based on an identifier of the first speaker.

### Claim 4 (depends on 3)

The method of claim 3, wherein the identifier comprises at least one of a telephone number, an IP address, a customer number, and an account number.

### Claim 5 (depends on 1)

The method of claim 1, wherein each of the first model and the second model comprises at least one of an acoustic model and a language model.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
identifying when the first speaker is speaking based on voice activity detection performed on the first audio channel; and
identifying when the second speaker is speaking based on voice activity detection performed on the second audio channel.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first audio signal is received from a first telecommunications terminal of the first speaker, and the second audio signal is received from a second telecommunications terminal of the second speaker.

### Claim 8

A system comprising:
a processor; and
a computer-readable storage device storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
receiving audio having a first audio channel of speech from a first speaker and a second audio channel of speech from a second speaker;
identifying a first speech recognition model for the first speaker;
identifying a second speech recognition model for the second speaker; and
based on voice activity detection, applying the first speech recognition model to the audio when the voice activity detection is positive in the first audio channel, and applying the second speech recognition model to the audio when the voice activity detection is positive in the second audio channel.

### Claim 9 (depends on 8)

The system of claim 8, wherein the operations further comprise:
caching the first speech recognition model and the second speech recognition model.

### Claim 10 (depends on 9)

The system of claim 9, wherein the operations further comprise:
switching between a cached first speech recognition model and a cached second speech recognition model to recognize speech in the audio.

### Claim 11 (depends on 8)

The system of claim 8, wherein each of the first speech recognition model and the second speech recognition model comprises at least one of an acoustic model and a language model.

### Claim 12 (depends on 8)

The system of claim 8, wherein identifying a first speech recognition model for the first speaker further comprises:
retrieving, from a database of speech recognition models, the first speech recognition model based on a unique identifier associated with the first audio channel.

### Claim 13 (depends on 8)

The system of claim 8, wherein the operations further comprise:
generating speech recognition output from applying the first speech recognition model and applying the second speech recognition model to the audio.

### Claim 14 (depends on 8)

The system of claim 8, wherein each of the first speech recognition model and the second speech recognition model is an acoustic model, and wherein the operations further comprise:
applying a common language model to the first audio channel and the second audio channel.

### Claim 15

A computer-readable storage device storing instructions which, when executed by a computing device, cause the computing device to perform operations comprising:
receiving audio having a first audio channel of speech from a first speaker and a second audio channel of speech from a second speaker;
identifying a first speech recognition model for the first speaker;
priming a second speech recognition model for the second speaker with data from the first speech recognition model; and
based on per-channel voice activity detection, applying the first speech recognition model to the audio when the voice activity detection is positive in the first audio channel, and applying the second speech recognition model to the audio when the voice activity detection is positive in the second audio channel.

### Claim 16 (depends on 15)

The computer-readable storage device of claim 15, wherein the operations further comprise:
determining, prior to priming the second speech recognition model, that the first speech recognition model is more developed than the second speech recognition model.

### Claim 17 (depends on 16)

The computer-readable storage device of claim 16, wherein determining that the first speech recognition model is more developed than the second speech recognition model is based on at least one of vocabulary size, accuracy of recognition results, subjective ratings, and a completeness score.

### Claim 18 (depends on 15)

The computer-readable storage device of claim 15, wherein priming the second speech recognition model for the second speaker with data from the first speech recognition model comprises copying at least part of the first speech recognition model in to the second speech recognition model.

### Claim 19 (depends on 15)

The computer-readable storage device of claim 15, wherein identifying the first speech recognition model for the first speaker is based on a unique identifier for the first speaker.

### Claim 20 (depends on 19)

The computer-readable storage device of claim 19, wherein the unique identifier comprises at least one of a telephone number, an IP address, a customer number, and an account number.
