# US 12,118,970 B2 · Compensating noise removal artifacts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,970 B2
- Document ID: US12118970B2
- Status: Granted
- Kind: B2
- Application number: 17/974,602
- Filed: 2022-10-27
- Published: 2023-05-04
- Granted: 2024-10-15
- Earliest claimed: 2021-11-03
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Mikko Olavi Heikkinen; Miikka Tapani Vilermo; Arto Juhani Lehtiniemi; Antti Johannes Eronen
- Web page: https://patentgrep.com/patent/US12118970B2

## CPC

- G10K 11/16: Methods or devices for protecting against, or for damping, noise or other acoustic waves in general (G10K11/36 takes precedence)
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04S 7/00: Indicating arrangements; Control arrangements, e.g. balance control
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- H04S: STEREOPHONIC SYSTEMS

## Abstract

An apparatus including circuitry configured to: obtain at least two audio signals; determine, with respect to the at least two audio signals, an audio object part and an ambience audio part; determine a level parameter based on the ambience audio part; apply a noise suppression to the audio object part, wherein the noise suppression is configured to be controlled based on the determined level parameter; and generate a noise suppressed audio object part based on the applied noise suppression.

## Claims

### Claim 1

An apparatus comprising:
at least one processor; and
at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus to:
obtain at least two audio signals;
determine, with respect to the at least two audio signals, an audio object part and an ambience audio part;
determine a level parameter based, at least partially, on the ambience audio part and the audio object part;
apply a noise suppression to the audio object part, wherein the noise suppression is configured to be controlled based on the determined level parameter; and
generate a noise suppressed audio object part based on the applied noise suppression and the audio object part.

### Claim 2 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
combine the noise suppressed audio object part and the ambience audio part to generate an output audio signal; and
output and/or store the output audio signal.

### Claim 3 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
separate the at least two audio signals into the determined audio object part and the ambience audio part; and
generate an audio object part audio signal based on a previous time level parameter.

### Claim 4 (depends on 3)

The apparatus as claimed in claim 3, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
determine an object separation direction parameter;
determine a focuser configuration based on the object separation direction parameter and the previous time level parameter; and
apply the focuser configuration to the at least two audio signals to generate the audio object part audio signal.

### Claim 5 (depends on 4)

The apparatus as claimed in claim 4, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
generate a first focuser filter with a first spatial width based on the previous time level parameter being equal to or more than a first value; and
generate a second focuser filter with a second spatial width based on the previous time level parameter being less than the first value, wherein the second spatial width is smaller than the first spatial width and the second focuser filter is more spatially selective than the first focuser filter.

### Claim 6 (depends on 4)

The apparatus as claimed in claim 4, wherein applying the focuser configuration to the at least two audio signals comprises the instructions, when executed with the at least one processor, cause the apparatus to:
remove the audio object part audio signal from the at least two audio signals to generate the ambience audio part.

### Claim 7 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
generate, with respect to a first time period, a first signal-to-noise ratio based on the audio object part of the at least two audio signals and the ambience audio part;
generate, with respect to a second time period, a second signal-to-noise ratio based on the audio object part of the at least two audio signals and the ambience audio part, wherein the first time period is shorter than the second time period;
combine the first and second signal-to-noise ratios to generate a combined signal-to-noise ratio;
multiply the combined signal-to-noise ratio with a factor based on the level parameter to generate a noise suppression filter parameter; and
apply a noise suppression filter with the noise suppression filter parameter to the audio object part.

### Claim 8 (depends on 1)

The apparatus as claimed in claim 1, wherein the level parameter comprises a level difference between the audio object part and the ambience audio part.

### Claim 9 (depends on 8)

The apparatus as claimed in claim 8, wherein the level difference is determined further based on the noise suppressed audio object part.

### Claim 10 (depends on 1)

The apparatus as claimed in claim 1, wherein the level parameter is determined based, at least partially, on an absolute level of the ambience audio part.

### Claim 11 (depends on 1)

The apparatus as claimed in claim 1, wherein the level parameter is determined for defined or selected frequency bands.

### Claim 12 (depends on 11)

The apparatus as claimed in claim 11, wherein applying the noise suppression comprises the instructions, when executed with the at least one processor, cause the apparatus to:
apply the noise suppression to the defined or selected frequency bands.

### Claim 13

A method comprising:
obtaining at least two audio signals;
determining, with respect to the at least two audio signals, an audio object part and an ambience audio part;
determining a level parameter based, at least partially, on the ambience audio part and the audio object part;
applying a noise suppression to the audio object part, wherein the noise suppression is configured to be controlled based on the determined level parameter; and
generating a noise suppressed audio object part based on the applied noise suppression and the audio object part.

### Claim 14 (depends on 13)

The method as claimed in claim 13, wherein the method further comprises:
combining the noise suppressed audio object part and the ambience audio part to generate an output audio signal; and
outputting and/or storing the output audio signal.

### Claim 15 (depends on 13)

The method as claimed in claim 13, further comprising:
separating the at least two audio signals into the determined audio object part and the ambience audio part;
wherein generating the noise suppressed audio object part based on the applied noise suppression comprises:
generating an audio object part audio signal based on a previous time level parameter.

### Claim 16 (depends on 15)

The method as claimed in claim 15, wherein generating the audio object part audio signal based on the previous time level parameter comprises:
determining an object separation direction parameter;
determining a focuser configuration based on the object separation direction parameter and the previous time level parameter; and
applying the focuser configuration to the at least two audio signals to generate the audio object part audio signal.

### Claim 17 (depends on 16)

The method as claimed in claim 16, wherein determining the focuser configuration based on the object separation direction parameter and the previous time level parameter comprises:
generating a first focuser filter with a first spatial width based on the previous time level parameter being equal to or more than a first value; and
generating a second focuser filter with a second spatial width based on the previous time level parameter being less than the first value, wherein the second spatial width is smaller than the first spatial width and the second focuser filter is more spatially selective than the first focuser filter.

### Claim 18 (depends on 16)

The method as claimed in claim 16, wherein applying the focuser configuration to the at least two audio signals comprises:
removing the audio object part audio signal from the at least two audio signals to generate the ambience audio part.

### Claim 19 (depends on 13)

The method as claimed in claim 13, wherein applying the noise suppression to the audio object part comprises:
generating, with respect to a first time period, a first signal-to-noise ratio based on the audio object part of the at least two audio signals and the ambience audio part;
generating, with respect to a second time period, a second signal-to-noise ratio based on the audio object part of the at least two audio signals and the ambience audio part, wherein the first time period is shorter than the second time period;
combining the first and second signal-to-noise ratios to generate a combined signal-to-noise ratio;
multiplying the combined signal-to-noise ratio with a factor based on the level parameter to generate a noise suppression filter parameter; and
applying a noise suppression filter with the noise suppression filter parameter to the audio object part.

### Claim 20

A non-transitory computer-readable medium comprising program instructions stored thereon for performing at least the following:
obtain at least two audio signals;
determine, with respect to the at least two audio signals, an audio object part and an ambience audio part;
determine a level parameter based, at least partially, on the ambience audio part and the audio object part;
apply a noise suppression to the audio object part, wherein the noise suppression is configured to be controlled based on the determined level parameter; and
generate a noise suppressed audio object part based on the applied noise suppression and the audio object part.
