# US 2024/0203438 A1 · Noise suppression for speech data with reduced power consumption

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203438 A1
- Document ID: US20240203438A1
- Status: Published application
- Kind: A1
- Application number: 18/081,492
- Filed: 2022-12-14
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Chandan KARADAGUR ANANDA REDDY; Navin CHATLANI
- Web page: https://patentgrep.com/patent/US20240203438A1

## CPC

- G10L 21/0208: Noise filtering
- G10L 21/0232: Processing in the frequency domain
- G10L 21/0224: Processing in the time domain
- G10L 25/60: for measuring the quality of voice signals
- G10L 2021/02163: {Only one microphone}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Implementations described herein relate to providing noise suppression for speech data with reduced power consumption. In some implementations, a computer-implemented method includes receiving a current time frame of speech data, e.g., after receiving a previous time frame associated with a previous noise suppression mask. The current time frame is transformed to a current frequency frame in the frequency domain. A noise classifier is used to determine whether to create a current noise suppression mask for the current frame. If it is determined to create the mask, the mask is created and multiplied by the current frequency frame to obtain a noise-suppressed frequency frame. If it is determined to not create the current mask, the previous noise suppression mask is multiplied with the current frequency frame to obtain the noise-suppressed frequency frame, without creating a mask. The noise-suppressed frequency frame is transformed to a time frame and output.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by one or more processors, a current time frame of speech data in a time domain;
transforming the current time frame to a current frequency frame of the speech data in a frequency domain;
determining, using a noise classifier, whether to create a current noise suppression mask for the current frequency frame based at least on noise content in the current frequency frame;
in response to determining to create the current noise suppression mask:
creating the current noise suppression mask for the current frequency frame based on the noise content in the current frequency frame; and
multiplying the current noise suppression mask with the current frequency frame to obtain a current noise-suppressed frequency frame of the speech data;
in response to determining to not create the current noise suppression mask:
multiplying another noise suppression mask with the current frequency frame to obtain the current noise-suppressed frequency frame of the speech data, without creating the current noise suppression mask;
transforming the current noise-suppressed frequency frame of the speech data to a current noise-suppressed time frame of the speech data that is in the time domain; and
outputting the current noise-suppressed time frame of the speech data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the noise classifier uses a machine-learning model to determine whether to create the current noise suppression mask for the current frequency frame.

### Claim 3 (depends on 2)

The method of claim 2, wherein the machine-learning model is trained based on speech data that does not include noise and noise data that includes background noise.

### Claim 4 (depends on 2)

The method of claim 2, wherein the machine-learning model is trained using a speech quality predictor that estimates a quality of the speech data.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining whether to create the current noise suppression mask for the current frequency frame is based on a magnitude of the noise content in the current frequency frame.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining whether to create the current noise suppression mask for the current frequency frame is based on a rate of change of the noise content in the current time frame relative to noise content in one or more previous time frames.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving a second time frame of the speech data in the time domain;
transforming the second time frame to a second frequency frame of the speech data in the frequency domain;
determining, using a noise classifier, whether to create a second noise suppression mask for the second frequency frame based at least on noise content in the second frequency frame; and
in response to determining to create the second noise suppression mask:
creating a second noise suppression mask based on the second frequency frame;
multiplying the second noise suppression mask with the second frequency frame to obtain a second noise-suppressed frequency frame;
transforming the second noise-suppressed frequency frame to a second noise-suppressed time frame; and
outputting the second noise-suppressed time frame of the speech data.

### Claim 8

A computing device comprising:
a processor; and
a memory coupled to the processor, with instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising:
receiving, by the processor, a current time frame of speech data in a time domain after receiving a first time frame of the speech data in the time domain, wherein the current time frame and the first time frame include speech content, and wherein a first noise suppression mask is associated with the first time frame;
transforming the current time frame to a current frequency frame of the speech data in a frequency domain;
determining, using a noise classifier, whether to create a current noise suppression mask for the current frequency frame based at least on noise content in the current frequency frame;
in response to determining to create the current noise suppression mask:
creating the current noise suppression mask for the current frequency frame based on the noise content in the current frequency frame; and
multiplying the current noise suppression mask with the current frequency frame to obtain a current noise-suppressed frequency frame of the speech data;
in response to determining to not create the current noise suppression mask:
multiplying the first noise suppression mask with the current frequency frame to obtain the current noise-suppressed frequency frame of the speech data, without creating the current noise suppression mask;
transforming the current noise-suppressed frequency frame of the speech data to a current noise-suppressed time frame of the speech data that is in the time domain; and
outputting the current noise-suppressed time frame of the speech data.

### Claim 9

A device comprising:
at least one battery;
at least one microphone;
a communication circuit coupled to the battery and the microphone;
a processor coupled to the battery and the microphone; and
a memory coupled to the processor, with instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising:
receiving, by the processor, a current time frame of speech data in a time domain;
transforming the current time frame of speech data to a current frequency frame of the speech data in a frequency domain;
determining, using a noise classifier, whether to create a current noise suppression mask for the current frequency frame based at least on noise content in the current frequency frame;
in response to determining to create the current noise suppression mask:
creating the current noise suppression mask for the current frequency frame based on the noise content in the current frequency frame; and
multiplying the current noise suppression mask with the current frequency frame to obtain a current noise-suppressed frequency frame of the speech data;
in response to determining to not create the current noise suppression mask:
multiplying the first noise suppression mask with the current frequency frame to obtain the current noise-suppressed frequency frame of the speech data, without creating the current noise suppression mask; and
transforming the current noise-suppressed frequency frame of the speech data to a current noise-suppressed time frame of the speech data that is in the time domain.
