# US 2024/0185869 A1 · Combining spatial audio streams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0185869 A1
- Document ID: US20240185869A1
- Status: Published application
- Kind: A1
- Application number: 18/552,132
- Filed: 2021-03-22
- Published: 2024-06-06
- Earliest claimed: 2021-03-22
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Mikko-Ville LAITINEN; Adriana VASILACHE; Tapani PIHLAJAKUJA; Lasse Juhani LAAKSONEN; Anssi Sakari RÄMÖ
- Web page: https://patentgrep.com/patent/US20240185869A1

## CPC

- G10L 19/032: Quantisation or dequantisation of spectral components
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L 19/002: Dynamic bit allocation (for perceptual audio coders G10L19/032)
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/0204: {using subband decomposition}
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

There is inter alia disclosed an apparatus for spatial audio encoding configured to determining an audio scene separation metric between an input audio signal and a further input audio signal. and using the audio scene separation metric for quantizing of at least one spatial audio parameter of the input audio signal.

## Claims

### Claim at position 1

1-44. (canceled)

### Claim 45

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
determine an audio scene separation metric between an input audio signal and a further input audio signal; and
use the audio scene separation metric for quantizing of at least one spatial audio parameter of the input audio signal.

### Claim 46 (depends on 45)

The apparatus as claimed in claim 45, further caused to:
use the audio scene separation metric for quantizing at least one spatial audio parameter of the further input audio signal.

### Claim 47 (depends on 46)

The apparatus as claimed in claim 46, wherein the apparatus caused to use the audio scene separation metric for quantizing the at least one spatial audio parameter of the further input audio signal is caused to:
select a quantizer from a plurality of quantizers for quantizing the at least one spatial audio parameter, wherein the selected quantizer is dependent on the audio scene separation metric; and
quantize the at least one spatial audio parameter with the selected quantizer.

### Claim 48 (depends on 47)

The apparatus as claimed in claim 47, wherein the at least one spatial audio parameter of the further input audio signal is an audio object energy ratio parameter for a time frequency tile of a first audio object signal of the further input audio signal.

### Claim 49 (depends on 48)

The apparatus as claimed in claim 48, wherein the audio object energy ratio parameter for the time frequency tile of the first audio object signal of the further input audio signal is determined by the apparatus being caused to:
determine an energy of the first audio object signal of a plurality of audio object signals for the time frequency tile of the further input audio signal;
determine an energy of each remaining audio object signal of the plurality of audio object signals; and
determine the ratio of the energy of the first audio object signal to the sum of the energies of the first audio object signal and remaining audio objects signals.

### Claim 50 (depends on 46)

The apparatus as claimed in claim 46, wherein the audio scene separation metric is determined between a time frequency tile of the input audio signal and a time frequency tile of the further input audio signal and wherein the apparatus caused to use the audio scene separation metric to determine the quantization of at least one spatial audio parameter of the further input audio signal is caused to:
determine a further audio scene separation metric between a further time frequency tile of the input audio signal and a further time frequency tile of the further input audio signal;
determine a factor to represent the audio scene separation metric and the further audio scene separation metric;
select a quantizer from a plurality of quantizers dependent on the factor; and
quantize a further at least one spatial audio parameter of the further input audio signal using the selected quantizer.

### Claim 51 (depends on 50)

The apparatus as claimed in claim 50, wherein the further at least one spatial audio parameter is an audio object direction parameter for an audio frame of the further input audio signal.

### Claim 52 (depends on 50)

The apparatus as claimed in claim 50, wherein the factor to represent the audio scene separation metric and the further audio scene separation metric is one of:
the mean of the audio scene separation metric and the further audio scene separation metric; or
the minimum of the audio scene separation metric and the further audio scene separation metric.

### Claim 53 (depends on 45)

The apparatus as claimed in claim 45, wherein the apparatus caused to use the audio scene separation metric for quantizing the at least one spatial audio parameter for the input audio signal is caused to:
multiply the audio scene separation metric with an energy ratio parameter calculated for a time frequency tile of the input audio signal;
quantize the product of the audio scene separation metric with the energy ratio parameter to produce a quantization index; and
use the quantization index to select a bit allocation for quantizing the at least one spatial audio parameter of the input audio signal.

### Claim 54 (depends on 53)

The apparatus as claimed in claim 53, wherein the at least one spatial audio parameter is a direction parameter for the time frequency tile of the input audio signal, and wherein the energy ratio parameter is a direct-to-total energy ratio.

### Claim 55 (depends on 45)

The apparatus as claimed in claim 45, wherein the apparatus caused to use the audio scene separation metric for quantizing the at least one spatial audio parameter of the input audio signal is caused to:
select a quantizer from a plurality of quantizers for quantizing an energy ratio parameter calculated for a time frequency tile of the input audio signal, wherein the selection is dependent on the audio scene separation metric;
quantize the energy ratio parameter using the selected quantizer to produce a quantization index; and
use the quantization index to select a bit allocation for quantizing the energy ratio parameter together with the at least one spatial audio parameter of the input signal.

### Claim 56 (depends on 45)

The apparatus as claimed in claim 45, wherein the audio scene separation metric provides a measure of relative contribution of each of the input audio signal and the further input audio signal to an audio scene comprising the input audio signal and the further input audio signal.

### Claim 57 (depends on 45)

The apparatus as claimed in claim 45, wherein the apparatus determines the audio scene separation metric by being caused to:
transform the input audio signal into a plurality of time frequency tiles;
transform the further input audio signal into a plurality of further time frequency tiles;
determine an energy value of at least one time frequency tile;
determine an energy value of at least one further time frequency tile; and
determine the audio scene separation metric as a ratio of the energy value of the at least one time frequency tile to the sum of the at least one time frequency tile and the at least one further time frequency tile.

### Claim 58 (depends on 45)

The apparatus as claimed in claim 45, wherein the input audio signal comprises two or more audio channel signals and wherein the further input audio signal comprises a plurality of audio object signals.

### Claim 59

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
decode a quantized audio scene separation metric; and
use the quantized audio scene separation metric to determine a quantized at least one spatial audio parameter associated with a first audio signal.

### Claim 60 (depends on 59)

The apparatus as claimed in claim 59, is further caused to:
use the quantized audio scene separation metric to determine a quantized at least one spatial audio parameter associated with a second audio signal.

### Claim 61 (depends on 60)

The apparatus as claimed in claim 60, wherein the apparatus caused to use the quantized audio scene separation metric to determine the quantized at least one spatial audio parameter representing the second audio signal is caused to:
select a quantizer from a plurality of quantizers used to quantize the at least one spatial audio parameter for the second audio signal, wherein the selection is dependent on the decoded quantized audio scene separation metric; and
determine the quantized at least one spatial audio parameter for the second audio signal from the selected quantizer used to quantize the at least one spatial audio parameter for the second audio signal.

### Claim 62 (depends on 61)

The apparatus as claimed in claim 61, wherein the at least one spatial audio parameter of the second input audio signal is an audio object energy ratio parameter for a time frequency tile of a first audio object signal of the second input audio signal.

### Claim 63 (depends on 59)

The apparatus as claimed in claim 59, wherein the apparatus caused to use the quantized audio scene separation metric to determine the quantized at least one spatial audio parameter associated with the first audio signal is caused to:
select a quantizer from a plurality of quantizers used to quantize an energy ratio parameter calculated for a time frequency tile of the first audio signal, wherein the selection is dependent on the decoded quantized audio scene separation metric;
determine the quantized energy ratio parameter from the selected quantizer; and
use the quantization index of the quantized energy ratio parameter for the decoding of the at least one spatial audio parameter of the first audio signal.

### Claim 64 (depends on 63)

The apparatus as claimed in claim 63, wherein the at least one spatial audio parameter is a direction parameter for the time frequency tile of the first audio signal, and wherein the energy ratio parameter is a direct-to-total energy ratio.

### Claim 65 (depends on 59)

The apparatus as claimed in claim 59, wherein the audio scene separation metric provides a measure of relative contribution of each of the first audio signal and the second audio signal to an audio scene comprising the first audio signal and the second audio signal.

### Claim 66 (depends on 59)

The apparatus as claimed in claim 59, wherein the first audio signal comprises two or more audio channel signals and wherein the second input audio signal comprises a plurality of audio object signals.
