US 12,634,397 B1Granted

Clock skew robust acoustic echo cancellation

AssigneeAmazon Technologies, Inc.

InventorsKarim Helwani, Erfan Soltanmohammadi, Michael Mark Goodwin, Arvindh Krishnaswamy

Life of this patent

Estimating the term…

Loading patent…

Abstract

Far-end audio samples may be received corresponding to far-end audio that is output from one or more audio output components. Near-end audio samples may be received corresponding to near-end audio that is captured by one or more audio input components. A plurality of acoustic path estimates and a plurality of clock skew estimates may be calculated in an alternating order, using a state-space model, based at least in part on the far-end audio samples and the near-end audio samples. A first acoustic path estimate and a first clock skew estimate may be used to calculate a second acoustic path estimate. A first portion of the far-end audio may be filtered with the second acoustic path estimate to generate a replica of echo in the first portion of the far-end audio. The replica of the echo may be removed from a corresponding second portion of the near-end audio.

Claims20

Dependent claims

A computing system comprising:

one or more processors;
and
one or more memories having stored therein instructions that, upon execution by the one or more processors, cause the computing system to perform computing operations comprising:
receiving far-end audio samples corresponding to far-end audio that is output from one or more audio output components at a near-end location, wherein the far-end audio is captured at a far-end location and transmitted to the near-end location;
receiving near-end audio samples corresponding to near-end audio that is captured by one or more audio input components at the near-end location;
calculating, using a state-space model, based at least in part on the far-end audio samples and the near-end audio samples, a plurality of acoustic path estimates and a plurality of clock skew estimates, wherein the plurality of acoustic path estimates approximate an acoustic path between the one or more audio output components and the one or more audio input components, and wherein the plurality of clock skew estimates approximate a clock skew caused by a difference between a far-end sampling rate associated with the one or more audio output components and a near-end sampling rate associated with the one or more audio input components, wherein the plurality of acoustic path estimates and the plurality of clock skew estimates are calculated in an alternating order, and wherein a first acoustic path estimate of the plurality of acoustic path estimates and a first clock skew estimate of the plurality of clock skew estimates are used to calculate a second acoustic path estimate of the plurality of acoustic path estimates;
filtering a first portion of the far-end audio with the second acoustic path estimate to generate a replica of echo in the first portion of the far-end audio;
and
removing the replica of the echo from a second portion of the near-end audio that corresponds to the first portion of the far-end audio.

6 more elements

A computer-implemented method comprising:

receiving far-end audio samples corresponding to far-end audio that is output from one or more audio output components at a near-end location, wherein the far-end audio is captured at a far-end location and transmitted to the near-end location;
receiving near-end audio samples corresponding to near-end audio that is captured by one or more audio input components at the near-end location;
calculating, using a state-space model, based at least in part on the far-end audio samples and the near-end audio samples, a plurality of acoustic path estimates and a plurality of clock skew estimates, wherein the plurality of acoustic path estimates and the plurality of clock skew estimates are calculated in an alternating order, and wherein a first acoustic path estimate of the plurality of acoustic path estimates and a first clock skew estimate of the plurality of clock skew estimates are used to calculate a second acoustic path estimate of the plurality of acoustic path estimates;
filtering a first portion of the far-end audio with the second acoustic path estimate to generate a replica of echo in the first portion of the far-end audio;
and
removing the replica of the echo from a second portion of the near-end audio that corresponds to the first portion of the far-end audio.

3 more elements

One or more non-transitory computer-readable storage media having stored thereon computing instructions that, upon execution by one or more computing devices, cause the one or more computing devices to perform computing operations comprising:

receiving far-end audio samples corresponding to far-end audio that is output from one or more audio output components at a near-end location, wherein the far-end audio is captured at a far-end location and transmitted to the near-end location;
receiving near-end audio samples corresponding to near-end audio that is captured by one or more audio input components at the near-end location;
calculating, using a state-space model, based at least in part on the far-end audio samples and the near-end audio samples, a plurality of acoustic path estimates and a plurality of clock skew estimates, wherein the plurality of acoustic path estimates and the plurality of clock skew estimates are calculated in an alternating order, and wherein a first acoustic path estimate of the plurality of acoustic path estimates and a first clock skew estimate of the plurality of clock skew estimates are used to calculate a second acoustic path estimate of the plurality of acoustic path estimates;
filtering a first portion of the far-end audio with the second acoustic path estimate to generate a replica of echo in the first portion of the far-end audio;
and
removing the replica of the echo from a second portion of the near-end audio that corresponds to the first portion of the far-end audio.

3 more elements

Dependencies are inferred from the claim text.