# US 2026/0095719 A1 · Audio rendering with spatial metadata interpolation and source position information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0095719 A1
- Document ID: US20260095719A1
- Status: Published application
- Kind: A1
- Application number: 19/410,639
- Filed: 2025-12-05
- Published: 2026-04-02
- Earliest claimed: 2020-12-21
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Mikko-Ville LAITINEN; Juha VILKAMO; Archontis POLITIS; Antti ERONEN; Leo MCCORMACK
- Web page: https://patentgrep.com/patent/US20260095719A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- H04S 7/304: {For headphones}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An apparatus comprising at least one processor and at least one memory storing instructions is provided. The instructions, when executed with the at least one processor, cause the apparatus to perform: obtaining two or more audio signal sets associated with respective audio signal set positions, generating time-frequency array audio signals based on the two or more audio signal sets, generating metadata for the time-frequency array audio signals, obtaining source position information, determining values related to sound source energies based on the time-frequency array audio signals, the audio signal set positions, and source position information, encoding the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies into at least one bitstream, and storing or outputting the at least one bitstream.

## Claims

### Claim 1

An apparatus, comprising:
at least one processor; and
at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:
obtain two or more audio signal sets associated with respective audio signal set positions;
generate time-frequency array audio signals based on the two or more audio signal sets;
generate metadata for the time-frequency array audio signals;
obtain source position information;
determine values related to sound source energies based on the time-frequency array audio signals, the audio signal set positions, and source position information;
encode the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies into at least one bitstream;
store or output the at least one bitstream.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to obtain the two or more audio signal sets from microphone arrangements, wherein the microphone arrangements are at respective positions and comprise one or more microphones.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to, before encoding, quantize the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the sound source position information is based on at least one prominent sound source.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the at least one prominent sound source is a sound source with an energy greater than a threshold value.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
generate a binaural audio output comprising two audio signals for headphones or earphones.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
generate a multichannel audio output comprising at least two audio signals for a multichannel speaker set.

### Claim 8

A method, comprising:
obtaining two or more audio signal sets associated with respective audio signal set positions;
generating time-frequency array audio signals based on the two or more audio signal sets;
generating metadata for the time-frequency array audio signals;
obtaining source position information;
determining values related to sound source energies based on the time-frequency array audio signals, the audio signal set positions, and source position information;
encoding the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies into at least one bitstream;
storing or outputting the at least one bitstream.

### Claim 9 (depends on 8)

The method of claim 8, wherein the two or more audio signal sets are obtained from microphone arrangements, wherein the microphone arrangements are at respective positions and comprise one or more microphones.

### Claim 10 (depends on 8)

The method of claim 8, further comprising, before encoding, quantizing the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies.

### Claim 11 (depends on 8)

The method of claim 8, wherein the sound source position information is based on at least one prominent sound source.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least one prominent sound source is a sound source with an energy greater than a threshold value.

### Claim 13 (depends on 8)

The method of claim 8, further comprising:
generating a binaural audio output comprising two audio signals for headphones or earphones.

### Claim 14 (depends on 8)

The method of claim 8, further comprising:
generating a multichannel audio output comprising at least two audio signals for a multichannel speaker set.

### Claim 15

A non-transitory computer readable medium comprising program instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:
obtaining two or more audio signal sets associated with respective audio signal set positions;
generating time-frequency array audio signals based on the two or more audio signal sets;
generating metadata for the time-frequency array audio signals;
obtaining source position information;
determining values related to sound source energies based on the time-frequency array audio signals, the audio signal set positions, and source position information;
encoding the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies into at least one bitstream;
storing or outputting the at least one bitstream.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the instructions, when executed with the at least one processor, cause the apparatus to obtain the two or more audio signal sets from microphone arrangements, wherein the microphone arrangements are at respective positions and comprise one or more microphones.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the instructions, when executed with the at least one processor, cause the apparatus to, before encoding, quantizing the two or more audio signal sets, the metadata, the audio signal set positions, the source position information and the source energies.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the sound source position information is based on at least one prominent sound source.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the at least one prominent sound source is a sound source with an energy greater than a threshold value.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the instructions, when executed with the at least one processor, cause the apparatus to perform at least one of the following:
generating a binaural audio output comprising two audio signals for at least one of headphones or earphones; and
generating a multichannel audio output comprising at least two audio signals for a multichannel speaker set.
