# US 2024/0203439 A1 · Noise Reduction Based on Dynamic Neural Networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203439 A1
- Document ID: US20240203439A1
- Status: Published application
- Kind: A1
- Application number: 18/285,940
- Filed: 2021-11-19
- Published: 2024-06-20
- Earliest claimed: 2021-05-08
- Applicants: Cerence Operating Company
- Inventors: Friedrich Faubel; Tim Haulick; Markus Buck
- Web page: https://patentgrep.com/patent/US20240203439A1

## CPC

- G10L 21/0232: Processing in the frequency domain
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 25/21: the extracted parameters being power information
- G10L 25/30: using neural networks
- G10L 21/0264: characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A hybrid noise-reducer provides an output audio signal by carrying out noise reduction on an input audio signal over a desired range of frequencies. The desired range of frequencies consists of the union of a base range of frequencies and a remainder range of frequencies. The noise reducer includes first and second noise-reduction paths of different types. The first noise-reduction path relies on a dynamic neural network that has been trained using the base range of frequencies. The second noise-reduction path relies on a noise estimation module that uses an estimate of signal-to-noise ratio estimate to identify noise within the remainder range.

## Claims

### Claim 1

An apparatus for generating an output audio signal (60) by suppressing noise in a first input spectrum (20) and noise in a second input spectrum (22), said first and second input spectra (20, 22) having been obtained from an input audio signal (12),
wherein said first input spectrum (20) represents first energy,
wherein said second input spectrum (22) represents second energy,
wherein said first energy is energy that is present in said input audio signal (12) and that is within a first frequency band, and
wherein said second energy is energy that is present in said input audio signal (12) and that is within a second frequency band,
said apparatus comprising a hybrid noise-reducer (10) that comprises a first noise-reduction path (24) and a second noise-reduction path (36),
wherein said first noise-reduction path receives said first input spectrum (20),
wherein said second noise-reduction path (36) receives said second input spectrum (22),
wherein said first noise-reduction path (24) is configured to apply a first noise-reduction method to said first input spectrum (20) by producing a first noise filter (26) for reducing noise in said first input spectrum (20),
wherein said second noise-reduction path (36) is configured to apply a second noise-reduction method to said second input spectrum (22) by producing a second noise filter (50) for reducing noise in said second input spectrum (22), and
wherein said second noise-reduction path (36) comprises weighting circuitry (52) that modifies said second noise filter (50) based at least in part on said first noise filter (26), thereby generating a third noise filter (38).

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein said hybrid noise-reduction system (10) further comprises multipliers (28, 40) that are configured to apply said first noise filter (26) to said first input spectrum (20) and to apply said third noise filter (38) to said second input spectrum (22) to yield a filtered first input spectrum (30) and a filtered second input spectrum (42), respectively.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein said hybrid noise-reduction system (10) further comprises stacking circuitry (54) that combines filtered first and second input spectra (30, 42) into an output spectrum (56) that represents a frequency-domain representation (16) of said input audio signal (12) with noise having been suppressed therein.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising a transform circuit (14) that receives said input audio signal (12) and provides a frequency-domain representation of said input 9 audio signal (12) from which said first and second input spectra (20, 22) are obtained.

### Claim 5 (depends on 1)

The apparatus of claim 1, further comprising a transform circuit (14) that is configured to carry out a short-term Fourier transform of said input audio signal (12).

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein said hybrid noise-reduction system (10) further comprises inverse-transform circuitry (58) that converts an output spectrum (56) into said output audio signal (60), said output spectrum (56) being representative of a frequency-domain representation of said input audio signal (12) with noise having been suppressed therein.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein said hybrid noise-reduction system (10) further comprises inverse-transform circuitry (58) that carries out an inverse short-term Fourier transform to convert an output spectrum (56) into said output audio signal (60), said output spectrum (56) being representative of a frequency-domain representation (16) of said input audio signal (12) with noise having been suppressed therein.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein said first noise-reduction path (24) comprises a dynamic neural network (34) that produces said first noise filter (26) based on features extracted from said first input spectrum (20).

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein said first noise-reduction path (24) is configured to provide a voice-activity signal (62) indicative of voice activity in said first input spectrum (20) and to provide said voice-activity signal (62) to said weighing circuitry (52) for use in modifying said second filter (50).

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein said first noise-reduction path (24) comprises a dynamic neural network (34) that was trained using frequencies in said first band.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein said second noise-reduction path (36) comprises an estimator (44) and a filter calculator (48) that determines said second noise filter (50) based on a noise estimate provided by said estimator (44).

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein said weighting circuitry (52) is configured to modify said second noise filter (50) to cause said third noise filter (38) to suppress noise that would not have been suppressed by said second noise filter (50) had said second noise filter (50) been applied to said input remainder-spectrum (22).

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein said weighting circuitry (52) is configured to modify said second noise filter (50) to prevent said third noise filter (38) from suppressing power present in said input remainder-spectrum that would have been suppressed by said second noise filter (50) had said second noise filter (50) been applied to said input remainder-spectrum (22).

### Claim 14 (depends on 1)

The apparatus of claim 1,
wherein there exists a first probability and a second probability,
wherein said first probability is a probability that speech is present in said input remainder-spectrum (22),
wherein said second probability is a conditional probability that speech is present in said input remainder-spectrum (22) given information concerning the presence of speech in said input base-spectrum (20), and
wherein said weighting circuitry (52) is configured to modify said second noise filter (50) based on a function of said first and second probabilities.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein said input base-spectrum has an upper bound of seven kilohertz.

### Claim 16 (depends on 1)

The apparatus of claim 1, wherein said remainder base-spectrum has a lower band that is equal to an upper bound of said input base-spectrum.

### Claim 17 (depends on 1)

The apparatus of claim 1, wherein said remainder base-spectrum has an upper bound that is equal to twenty-four kilohertz.

### Claim 18 (depends on 1)

The apparatus of claim 1, wherein said remainder base-spectrum has an upper bound that is equal to 11.5 kilohertz.

### Claim 19

A method comprising reducing noise in an input audio signal, wherein reducing said noise comprises
splitting a frequency-domain representation of said input audio signal into first and second input spectra,
using a first noise-reduction method, generating a first filter for reducing noise in said first input spectrum, thereby generating a first output spectrum,
using a second noise-reduction method that includes use of information obtained from having used said first noise-reduction method, generating a second filter for reducing noise in said second input spectrum, thereby generating a second output spectrum, and
outputting a time-domain signal formed from having transformed a frequency-domain signal that resulted from having combined said first and second output spectra.
