# US 2023/0143857 A1 · Spatial Audio Reproduction by Positioning at Least Part of a Sound Field

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0143857 A1
- Document ID: US20230143857A1
- Status: Published application
- Kind: A1
- Application number: 17/978,683
- Filed: 2022-11-01
- Published: 2023-05-11
- Earliest claimed: 2021-11-09
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Mikko-Ville Laitinen; Antti Johannes Eronen
- Web page: https://patentgrep.com/patent/US20230143857A1

## CPC

- G10K 15/12: using electronic time-delay networks
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04S 1/002: {Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution (control circuits for electronic adaptation of the sound field H04S7/30)}
- H04S 7/305: {Electronic adaptation of stereophonic audio signals to reverberation of the listening space (H04S7/301 takes precedence)}
- H04R 2430/21: Direction finding using differential microphone array [DMA]
- H04S 7/304: {For headphones}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An apparatus for positioning at least part of a sound field based on a target direction, the apparatus comprising means configured to: obtain at least one audio signal; obtain speaker setup information; obtain, for at least two processing paths, at least one processing path parameter, the at least one processing path parameter comprising a target direction associated with each of the at least two processing paths; process, for each of the at least two processing paths, the at least one audio signal based on the at least one processing path parameter to generate a multiple-channel audio signal, wherein for each processing path the means is configured to: generate at least two at least partly mutually incoherent audio signals from the at least one audio signal; determine at least two panning gains based on the target direction associated with the processing path and the speaker setup information; apply each of the at least two panning gains with an associated one of the at least partly mutually incoherent audio signal to generate at least two panning gain applied at least partly mutually incoherent audio signals; and combine the at least two panning gain applied at least partly mutually incoherent audio signals to generate the multiple-channel audio signal; and combine the multiple-channel audio signal from each processing path to generate a combined panning gain applied multiple-channel audio signal.

## Claims

### Claim 1

An apparatus for positioning at least part of a sound field based on a target direction, the apparatus comprising:
at least one processor; and
at least one non-transitory memory storing instructions that, when executed with the at least one processor, cause the apparatus to:
obtain at least one audio signal;
obtain speaker setup information;
obtain, for at least two processing paths, at least one processing path parameter, the at least one processing path parameter comprising a target direction associated with each of the at least two processing paths;
process, for each of the at least two processing paths, the at least one audio signal based on the at least one processing path parameter to generate a multiple-channel audio signal, wherein for each processing path the instructions, when executed with the at least one processor, cause the apparatus to:
generate at least two at least partly mutually incoherent audio signals from the at least one audio signal;
determine at least two panning gains based on the target direction associated with the processing path and the speaker setup information;
apply each of the at least two panning gains with an associated one of the at least partly mutually incoherent audio signal to generate at least two panning gain applied at least partly mutually incoherent audio signals; and
combine the at least two panning gain applied at least partly mutually incoherent audio signals to generate the multiple-channel audio signal; and
combine the multiple-channel audio signal from each processing path to generate a combined panning gain applied multiple-channel audio signal.

### Claim 2 (depends on 1)

The apparatus as claimed in claim 1, wherein the at least one processing path parameter further comprises at least one reverberation parameter associated with each of the at least two processing paths, wherein the instructions, when executed with the at least one processor, cause the apparatus to generate at least two at least partly mutually incoherent audio signals from the at least one audio signal is configured to reverberate, based on the at least one reverberation parameter, the at least one audio signal to generate each of the at least two at least partly mutually incoherent audio signal.

### Claim 3 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
decorrelate the at least one audio signal to generate each of the at least two at least partly mutually incoherent audio signals.

### Claim 4 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to apply vector-base amplitude panning based on the target direction associated with the processing path and directions associated with the speaker setup information.

### Claim 5 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to generate an immersive audio signal based on processing the combined panning gain applied multiple-channel audio signal.

### Claim 6 (depends on 5)

The apparatus as claimed in claim 5, wherein the instructions, when executed with the at least one processor, cause the apparatus to:
process, for each channel of the combined panning gain applied multiple-channel audio signal, the combined panning gain applied multiple-channel audio signal based on a head related transfer function associated with a direction for a loudspeaker associated with the channel to generate a channel binaural panning processed audio signal; and
combine, for all channels, the channel binaural panning processed audio signal to generate the immersive audio signal.

### Claim 7 (depends on 1)

The apparatus as claimed in claim 1, wherein the instructions, when executed with the at least one processor, cause the apparatus to one of:
receive speaker setup information;
determine speaker setup information; or
obtain predetermined or default speaker setup information.

### Claim 8 (depends on 1)

The apparatus as claimed in claim 1, wherein the at least two at least partly mutually incoherent audio signals are mutually incoherent audio signals.

### Claim 9

A method for an apparatus for positioning at least part of a sound field based on a target direction, the method comprising:
obtaining at least one audio signal;
obtaining speaker setup information;
obtaining, for at least two processing paths, at least one processing path parameter, the at least one processing path parameter comprising a target direction associated with each of the at least two processing paths;
processing, for each of the at least two processing paths, the at least one audio signal based on the at least one processing path parameter to generate a multiple-channel audio signal, wherein for processing comprises:
generating at least two at least partly mutually incoherent audio signals from the at least one audio signal;
determining at least two panning gains based on the target direction associated with the processing path and the speaker setup information;
applying each of the at least two panning gains with an associated one of the at least partly mutually incoherent audio signal to generate at least two panning gain applied at least partly mutually incoherent audio signals; and
combining the at least two panning gain applied at least partly mutually incoherent audio signals to generate the multiple-channel audio signal; and
combining the multiple-channel audio signal from each processing path to generate a combined panning gain applied multiple-channel audio signal.

### Claim 10 (depends on 9)

The method as claimed in claim 9, wherein the at least one processing path parameter further comprises at least one reverberation parameter associated with each of the at least two processing paths, wherein generating at least two at least partly mutually incoherent audio signals from the at least one audio signal comprises reverberating, based on the at least one reverberation parameter, the at least one audio signal to generate each of the at least two at least partly mutually incoherent audio signal.

### Claim 11 (depends on 10)

The method as claimed in claim 10, wherein generating at least two at least partly mutually incoherent audio signals from the at least one audio signal comprises decorrelating the at least one audio signal to generate each of the at least two at least partly mutually incoherent audio signals.

### Claim 12 (depends on 9)

The method as claimed in claim 9, wherein determining at least two panning gains based on the target direction associated with the processing path and the speaker setup information comprises applying vector-base amplitude panning based on the target direction associated with the processing path and directions associated with the speaker setup information.

### Claim 13 (depends on 9)

The method as claimed in claim 9, wherein the method comprises generating an immersive audio signal based on processing the combined panning gain applied multiple-channel audio signal.

### Claim 14 (depends on 13)

The method as claimed in claim 13, wherein generating the immersive audio signal based on processing the combined panning gain applied multiple-channel audio signal comprises:
processing, for each channel of the combined panning gain applied multiple-channel audio signal, the combined panning gain applied multiple-channel audio signal based on a head related transfer function associated with a direction for a loudspeaker associated with the channel to generate a channel binaural panning processed audio signal; and
combining, for all channels, the channel binaural panning processed audio signal to generate the immersive audio signal.

### Claim 15 (depends on 9)

The method as claimed in claim 9, wherein obtaining speaker setup information comprises one of:
receiving speaker setup information;
determining speaker setup information; or
obtaining predetermined or default speaker setup information.

### Claim 16 (depends on 9)

The method as claimed in claim 9, wherein the at least two at least partly mutually incoherent audio signals are mutually incoherent audio signals.

### Claim 17 (depends on 1)

The apparatus as claimed in claim 1, wherein the obtained at least one audio signal is at least one microphone audio signal.

### Claim 18 (depends on 1)

The apparatus as claimed in claim 1, wherein the speaker setup information represents a loudspeaker setup.

### Claim 19 (depends on 11)

The method as claimed in claim 11, wherein the at least one audio signal is at least one microphone audio signal.

### Claim 20 (depends on 11)

The method as claimed in claim 11, wherein the speaker setup information represents a loudspeaker setup.
