# US 2003/0216911 A1 · Method of noise reduction based on dynamic aspects of speech

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0216911 A1
- Document ID: US20030216911A1
- Status: Published application
- Kind: A1
- Application number: 10/152,143
- Filed: 2002-05-20
- Published: 2003-11-20
- Earliest claimed: 2002-05-20
- Assignees: Microsoft Corporation
- Inventors: Li Deng; James G. Droppo; Alejandro Acero
- Web page: https://patentgrep.com/patent/US20030216911A1

## CPC

- G10L 21/0208: Noise filtering
- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system and method are provided that reduce noise in pattern recognition signals. To do this, embodiments of the present invention utilize a prior model of dynamic aspects of clean speech together with one or both of a prior model of static aspects of clean speech, and an acoustic model that indicates the relationship between clean speech, noisy speech and noise. In one embodiment, components of a noise-reduced feature vector are produced by forming a weighted sum of predicted values from the prior model of dynamic aspects of clean speech, the prior model of static aspects of clean speech and the acoustic-environmental model.

## Claims

### Claim 1

A method for reducing noise in a noisy input signal, the method comprising:
converting a frame of the noisy input signal into an input feature vector;
obtaining a static-based prediction for a noise-reduced feature vector using a prior model of static aspects of clean signals;
obtaining a dynamic-based prediction for the noise-reduced feature vector using a prior model of dynamic aspects of clean signals;
combining the static-based prediction and the dynamic-based prediction to form at least part of a combined prediction; and
multiplying the combined prediction by a measure of the probability of the input feature vector occurring to produce at least one component of the noise-reduced feature vector.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
performing the steps of obtaining a static-based prediction, obtaining a dynamic-based prediction, determining a measure of the probability of the input feature vector occurring, combining the static-based prediction and the dynamic-based prediction, and multiplying the combined prediction by the measure of the probability for each of a set of mixture components, each mixture component providing a component of the reduced-noise feature vector; and
combining each component of the reduced-noise feature vector together to form the reduced-noise feature vector.

### Claim 3 (depends on 1)

The method of claim 1 wherein obtaining a static-based prediction comprises using a mean of a distribution of the prior model of static aspects of clean signals as the static-based prediction.

### Claim 4 (depends on 1)

The method of claim 1 wherein obtaining a dynamic-based prediction comprises adding a noise-reduced feature vector from a preceding frame to a mean of a distribution of the prior model of dynamic aspects of clean signals.

### Claim 5 (depends on 1)

The method of claim 1 wherein combining the static-based prediction and the dynamic-based prediction comprises:
multiplying the static-based prediction by a static-specific weighting value to produce a weighted static-based prediction;
multiplying the dynamic-based prediction by a dynamic-specific weighting value to produce a weighted dynamic-based prediction;
adding the weighted static-based prediction to the weighted dynamic-based prediction to form at least part of the combined prediction.

### Claim 6 (depends on 5)

The method of claim 5 wherein the static-specific weighting value is a function of a variance of a distribution in the prior model of dynamic aspects of clean signals.

### Claim 7 (depends on 5)

The method of claim 5 wherein the dynamic-specific weighting value is a function of a variance of a distribution in the prior model of static aspects of clean signals.

### Claim 8 (depends on 1)

The method of claim 1 further comprising obtaining an acoustic environment-based prediction of the noise-reduced feature vector and wherein combining the static-based prediction and the dynamic-based prediction further comprises combining the static-based prediction, the dynamic-based prediction and the acoustic environment-based prediction to form at least part of the combined prediction.

### Claim 9 (depends on 8)

The method of claim 8 wherein obtaining an acoustic environment-based prediction comprises:
estimating noise in a frame of the noisy input signal; and
using the noise estimate in a function to determine the acoustic environment-based prediction.

### Claim 10 (depends on 9)

The method of claim 9 wherein using the noise estimate in a function comprises using the noise estimate in a function that includes a Taylor Series approximation.

### Claim 11 (depends on 10)

The method of claim 10 wherein the Taylor series approximation is a zero-th order Taylor series expansion.

### Claim 12 (depends on 11)

The method of claim 11 wherein using the noise estimate in a function further comprises also using the input feature vector in the function.

### Claim 13

A computer-readable medium having computer-executable instructions for performing steps comprising:
using a prior model of static aspects of clean speech to produce a static-based predicted value;
using a prior model of dynamic aspects of clean speech to produce a dynamic-based predicted value;
applying a noisy feature vector representing a frame of noisy speech to an acoustic environment model to produce an acoustic environment-based predicted value; and
combining the static-based predicted value, the dynamic-based predicted value and the acoustic environment-based predicted value to form at least one component of a noise-reduced feature vector.

### Claim 14 (depends on 13)

The computer-readable medium of claim 13 wherein using a prior model of static aspects of clean speech comprises selecting a mean of a distribution in the prior model of static aspects of clean speech as the static-based predicted value.

### Claim 15 (depends on 13)

The computer-readable medium of claim 13 wherein using a prior model of dynamic aspects of clean speech comprises adding a noise-reduced feature vector to a mean of a distribution in the prior model of dynamic aspects of clean speech to produce the dynamic-based predicted value.

### Claim 16 (depends on 13)

The computer-readable medium of claim 13 wherein applying a noisy feature vector to an acoustic environment model further comprises applying an estimate of the noise in the frame to the acoustic environment model.

### Claim 17 (depends on 16)

The computer-readable medium of claim 16 wherein the acoustic environment model is based on a non-linear function that describes a relationship between a noisy feature vector, a clean feature vector, and a noise feature vector.

### Claim 18 (depends on 17)

The computer-readable medium of claim 17 wherein the acoustic environment model is formed from a Taylor series approximation to the non-linear function.

### Claim 19 (depends on 13)

The computer-readable medium of claim 13 wherein combining the static-based predicted value, the dynamic-based predicted value and the acoustic environment-based predicted value comprises:
applying separate weights to each of the static-based predicted value, the dynamic-based predicted value and the acoustic environment-based predicted value to form a weighted static-based value, a weighted dynamic-based value and a weighted acoustic environment-based value; and
summing the weighted static-based value, the weighted dynamic-based value and the weighted acoustic environment-based value.

### Claim 20 (depends on 19)

The computer-readable medium of claim 19 wherein the weight applied to the static-based predicted value is a function of a variance for a distribution in the prior model of the dynamic aspects of clean speech.

### Claim 21 (depends on 19)

The computer-readable medium of claim 19 wherein the weight applied to the dynamic-based predicted value is a function of a variance for a distribution in the prior model of the static aspects of clean speech.

### Claim 22 (depends on 13)

The computer-readable medium of claim 13 further comprising:
repeating the steps to produce a static-based predicted, value, to produce a dynamic-based predicted value, to produce an acoustic environment-based predicted value, and to combine the static-based predicted value, the dynamic-based predicted value and the acoustic environment-based predicted value for each mixture component in a set of mixture components to thereby produce a set of components for the noise-reduced feature vector; and
combining the components in the set of components for the noise-reduced feature vector to produce the noise-reduced feature vector.

### Claim 23

A method of reducing noise in a noisy speech signal, the method comprising:
predicting a dynamic-based noise-reduced value using a model of dynamic aspects of speech;
predicting an acoustic environment-based noise-reduced value using a model of an acoustic environment;
combining the dynamic-based noise-reduced value and the acoustic environment-based noise-reduced value to produce at least one component of a noise-reduced portion of the noisy speech signal.

### Claim 24 (depends on 23)

The method of claim 23 wherein the noise-reduced portion of the noisy speech signal is a feature vector.

### Claim 25 (depends on 23)

The method of claim 23 further comprising performing the steps of predicting a dynamic-based noise-reduced value, predicting an acoustic environment-based noise-reduced value and combining the dynamic-based noise-reduced value and the acoustic environment-based noise reduced value for each of a set of mixture components.
