# US 2012/0250882 A1 · Integrated echo cancellation and noise suppression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0250882 A1
- Document ID: US20120250882A1
- Status: Published application
- Kind: A1
- Application number: 13/079,548
- Filed: 2011-04-04
- Published: 2012-10-04
- Earliest claimed: 2011-04-04
- Assignees: QUALCOMM Incorporated
- Inventors: Asif I. Mohammad; Kwokleung Chan; Ian Eman Liu; Erik Visser; Dinesh Ramakrishnan
- Web page: https://patentgrep.com/patent/US20120250882A1

## CPC

- H04B 3/234: {using double talk detection}
- G10L 21/0208: Noise filtering
- H04M 9/082: {using echo cancellers (echo cancellers per se H04B3/23)}
- G10L 2021/02082: {the noise being echo, reverberation of the speech}
- G10L 2021/02166: {Microphone arrays; Beamforming}
- H04B: TRANSMISSION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A method for echo cancellation and noise suppression is disclosed. Linear echo cancellation (LEC) is performed for a primary microphone channel on an entire frequency band or in a range of frequencies where echo is audible. LEC is performed on one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective. The microphone channels are spatially processed over the lower frequency range after LEC. Non-linear noise suppression post-processing is performed on the entire frequency band. Echo post-processing is performed on the entire frequency band.

## Claims

### Claim 1

A method for echo cancellation and noise suppression, comprising:
performing linear echo cancellation (LEC) for a primary microphone channel on an entire frequency band or in a range of frequencies where echo is audible;
performing LEC for one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective;
spatially processing the microphone channels over the lower frequency range after LEC;
performing non-linear noise suppression post-processing on the entire frequency band; and
performing echo post-processing on the entire frequency band.

### Claim 2 (depends on 1)

The method of claim 1, wherein higher frequencies of the primary microphone channel are preserved through the spatial processing.

### Claim 3 (depends on 1)

The method of claim 1, wherein the spatial processing comprises beamforming or phase correlation-based masking.

### Claim 4 (depends on 1)

The method of claim 1, wherein the lower frequency range that is non-linear noise suppression post-processed has been spatially processed and a higher frequency range that is non-linear noise suppression post-processed is from the primary microphone channel and has not been spatially processed.

### Claim 5 (depends on 1)

The method of claim 1, wherein the spatial processing is performed based on a doubletalk flag that indicates when far-end speech and near-end speech periods overlap or when echo attenuation provided during linear echo cancellation is low.

### Claim 6 (depends on 5)

The method of claim 5, wherein the doubletalk flag is determined using a computed probability according to the equation
prob
=
(
1
-
(
1
1
+

-
ERLE
)
)
,
wherein ERLE is a measure of echo attenuation provided during linear echo cancellation.

### Claim 7 (depends on 6)

The method of claim 6, wherein no spatial processing is performed when the doubletalk flag indicates that far-end and near-end speech periods overlap or that echo attenuation provided by a linear echo cancellation (LEC) module is low.

### Claim 8 (depends on 5)

The method of claim 5, wherein the echo post-processing comprises:
performing non-linear echo post-processing on the microphone channels based on one or more doubletalk flags, wherein the non-linear echo post-processing removes residual non-linear echo from the microphone channels;
performing non-linear echo clipping based on clipping flags that indicate high attenuation of the primary microphone channel during linear echo cancellation, wherein the non-linear echo clipping removes residual echo from the microphone channels; and
injecting comfort noise into the microphone channels.

### Claim 9 (depends on 8)

The method of claim 8, wherein the clipping flags track echo attenuation during linear echo cancellation.

### Claim 10 (depends on 9)

The method of claim 9, wherein the clipping flag is high if echo attenuation provided during linear echo cancellation is above a predetermined threshold and low if the echo attenuation provided during linear echo cancellation is below a predetermined threshold.

### Claim 11

An apparatus for echo cancellation and noise suppression, comprising:
a linear echo canceller that performs linear echo cancellation (LEC) for a primary microphone channel on an entire frequency band or a portion of the entire frequency band where echo is audible and one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective;
a spatial processor that spatially processes the microphone channels over the lower frequency range after LEC;
a non-linear noise suppression post-processor that performs non-linear noise suppression post-processing on the entire frequency band; and
an echo post-processor that performs echo post-processing on the entire frequency band.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein higher frequencies of the primary microphone channel are preserved through the spatial processing.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the spatial processor uses beamforming or phase correlation-based masking to spatially process the microphone channels.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the lower frequency range received at the non-linear noise suppression post-processor has been spatially processed and a higher frequency range received at the non-linear noise suppression post-processor is from the primary microphone channel and has not been spatially processed.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the spatial processor operates based on a doubletalk flag that indicates when far-end speech and near-end speech periods overlap or when echo attenuation provided by the linear echo canceller is low.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the doubletalk flag is determined using a computed probability according to the equation
prob
=
(
1
-
(
1
1
+

-
ERLE
)
)
,
wherein ERLE is a measure of echo attenuation provided by the linear echo canceller.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the spatial processor does not spatially process the microphone channels when the doubletalk flag indicates that far-end and near-end speech periods overlap or that echo attenuation provided by the linear echo canceller is low.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein the echo post-processing comprises:
a non-linear echo post-processor that performs non-linear echo post-processing on the microphone channels based on one or more doubletalk flags, wherein the non-linear echo post-processing removes residual non-linear echo from the microphone channels;
a non-linear echo clipper that performs non-linear echo clipping based on clipping flags that indicate high attenuation of the primary microphone channel during linear echo cancellation, wherein the non-linear echo clipping removes residual echo from the microphone channels; and
a comfort noise injector that injects comfort noise into the microphone channels.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the clipping flags track echo attenuation during linear echo cancellation.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the clipping flag is high if echo attenuation provided by the linear echo canceller is above a predetermined threshold and low if the echo attenuation provided by the linear echo canceller is below a predetermined threshold.

### Claim 21

An apparatus for echo cancellation and noise suppression, comprising:
means for performing linear echo cancellation (LEC) for a primary microphone channel on an entire frequency band or a portion of the entire frequency band where echo is audible;
means for performing LEC for one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective;
means for spatially processing the microphone channels over the lower frequency range after LEC;
means for performing non-linear noise suppression post-processing on the entire frequency band; and
means for performing echo post-processing on the entire frequency band.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein higher frequencies of the primary microphone channel are preserved through the spatial processing.

### Claim 23 (depends on 21)

The apparatus of claim 21, wherein the means for spatially processing uses beamforming or phase correlation-based masking to spatially process the microphone channels.

### Claim 24 (depends on 21)

The apparatus of claim 21, wherein the lower frequency range received at the means for performing non-linear noise suppression post-processing has been spatially processed and a higher frequency range received at the means for performing non-linear noise suppression post-processing is from the primary microphone channel and has not been spatially processed.

### Claim 25 (depends on 21)

The apparatus of claim 21, wherein the means for spatially processing operates based on a doubletalk flag that indicates when far-end speech and near-end speech periods overlap or when echo attenuation provided by the means for performing linear echo cancellation is low.

### Claim 26 (depends on 25)

The apparatus of claim 25, wherein the doubletalk flag is determined using a computed probability according to the equation
prob
=
(
1
-
(
1
1
+

-
ERLE
)
)
,
wherein ERLE is a measure of echo attenuation provided by the means for performing linear echo cancellation.

### Claim 27 (depends on 26)

The apparatus of claim 26, wherein the spatial processor does not spatially process the microphone channels when the doubletalk flag indicates that far-end and near-end speech periods overlap or that echo attenuation provided by the means for performing linear echo cancellation is low.

### Claim 28 (depends on 25)

The apparatus of claim 25, wherein the echo post-processing comprises:
means for performing non-linear echo post-processing on the microphone channels based on one or more doubletalk flags, wherein the non-linear echo post-processing removes residual non-linear echo from the microphone channels;
means for performing non-linear echo clipping based on clipping flags that indicate high attenuation of the primary microphone channel during linear echo cancellation, wherein the non-linear echo clipping removes residual echo from the microphone channels; and
means for injecting comfort noise into the microphone channels.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the clipping flags track echo attenuation by the means for performing linear echo cancellation.

### Claim 30 (depends on 29)

The apparatus of claim 29, wherein the clipping flag is high if echo attenuation provided by the means for performing linear echo cancellation is above a predetermined threshold and low if the echo attenuation provided by the means for performing linear echo cancellation is below a predetermined threshold.

### Claim 31

A computer-program product for echo cancellation and noise suppression, the computer-program product comprising a non-transitory computer-readable medium having instructions thereon, the instructions comprising:
code for causing a communication device to perform linear echo cancellation (LEC) for a primary microphone channel on an entire frequency band or a portion of the entire frequency band where echo is audible;
code for causing the communication device to perform LEC for one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective;
code for causing the communication device to spatially process the microphone channels over the lower frequency range after LEC;
code for causing the communication device to perform non-linear noise suppression post-processing on the entire frequency band; and
code for causing the communication device to perform echo post-processing on the entire frequency band.

### Claim 32 (depends on 31)

The computer-program product of claim 31, wherein higher frequencies of the primary microphone channel are preserved through the spatial processing.

### Claim 33 (depends on 31)

The computer-program product of claim 31, wherein the code for causing the communication device to spatially process comprises code for causing the communication device to perform beamforming or phase correlation-based masking.

### Claim 34 (depends on 31)

The computer-program product of claim 31, wherein the lower frequency range that is non-linear noise suppression post-processed has been spatially processed and a higher frequency range that is non-linear noise suppression post-processed is from the primary microphone channel and has not been spatially processed.

### Claim 35 (depends on 31)

The computer-program product of claim 31, wherein the code for causing the communication device to spatially process is based doubletalk flag indicates when far-end speech and near-end speech periods overlap or when echo attenuation provided during linear echo cancellation is low.

### Claim 36 (depends on 35)

The computer-program product of claim 35, further comprising code for causing the communication device to determine the doubletalk flag using a computed probability according to the equation
prob
=
(
1
-
(
1
1
+

-
ERLE
)
)
,
wherein ERLE is a measure of echo attenuation provided during linear echo cancellation.

### Claim 37 (depends on 36)

The computer-program product of claim 36, wherein the code for causing the communication device to spatially process comprises code for causing the communication device to not spatially process when the doubletalk flag indicates that far-end and near-end speech periods overlap or that echo attenuation provided by the LEC module is low.

### Claim 38 (depends on 31)

The computer-program product of claim 31, wherein the code for causing the communication device to perform echo post-processing comprises:
code for causing the communication device to perform non-linear echo post-processing on the microphone channels based on one or more doubletalk flags, wherein the non-linear echo post-processing removes residual non-linear echo from the microphone channels;
code for causing the communication device to perform non-linear echo clipping based on clipping flags that indicate high attenuation of the primary microphone channel during linear echo cancellation, wherein the non-linear echo clipping removes residual echo from the microphone channels; and
code for causing the communication device to inject comfort noise into the microphone channels.

### Claim 39 (depends on 38)

The computer-program product of claim 38, wherein the clipping flags track echo attenuation during linear echo cancellation.

### Claim 40 (depends on 39)

The computer-program product of claim 39, wherein the clipping flag is high if echo attenuation provided during linear echo cancellation is above a predetermined threshold and low if the echo attenuation provided during linear echo cancellation is below a predetermined threshold.
