# US 2022/0286802 A1 · Spatial audio modification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286802 A1
- Document ID: US20220286802A1
- Status: Published application
- Kind: A1
- Application number: 17/683,482
- Filed: 2022-03-01
- Published: 2022-09-08
- Earliest claimed: 2021-03-04
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Lasse LAAKSONEN
- Web page: https://patentgrep.com/patent/US20220286802A1

## CPC

- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- H04S 7/303: {Tracking of listener position or orientation}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: obtaining an input audio signal comprising at least first audio content and second audio content; rendering an output audio signal with the first and second audio content spatialised in an audio scene; and increasing a distance, within the audio scene, between the first and second audio content in response to an increase in distance, in the real world, between a user and a default listening position relative to a device.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

An apparatus comprising:
at least one processor; and
at least one memory including computer program code,
the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
obtain an input audio signal comprising at least first audio content and second audio content;
render an output audio signal with the first audio content and the second audio content spatialized in an audio scene; and
in response to an increase in distance, in the real world, between a user and a default listening position relative to a device, increase a distance, within the audio scene, between the first audio content and the second audio content.

### Claim 17 (depends on 16)

The apparatus of claim 16 wherein the first audio content has a default position corresponding to spatial information comprised in the input audio signal, and wherein as the distance, in the real world, between the user and the default listening position increases, the first audio content maintains its default position within the audio scene.

### Claim 18 (depends on 16)

The apparatus of claim 16 wherein with the user at the default listening position, there is a first distance between the user and the second audio content in the audio scene;
wherein with the user displaced from the default listening position, in the real world, there is a second distance between the user and the second audio content in the audio scene; and
wherein the second distance is greater than the first distance.

### Claim 19 (depends on 16)

The apparatus of claim 16 wherein the position of the second audio content within the audio scene is dependent on the direction in which the user is displaced from the default listening position.

### Claim 20 (depends on 16)

The apparatus of claim 16 wherein the second audio content has a default position corresponding to spatial information comprised in the input audio signal, and wherein increasing the distance, within the audio scene, between the first and second audio content comprises displacement of the second audio content from its default position within the audio scene.

### Claim 21 (depends on 20)

The apparatus of claim 20 wherein the displacement of the second audio content from its default position within the audio scene comprises a translation equal to:
a scalar multiple of a displacement of the second audio content from the user at its default position, the scalar multiple depending on a magnitude of a displacement of the default listening position from the user; or
the displacement of the default listening position from the user.

### Claim 22 (depends on 21)

The apparatus of claim 21 wherein the scalar multiple further depends on the direction of the displacement of the default listening position from the user.

### Claim 23 (depends on 21)

The apparatus of claim 21 wherein the translation is selected based on the direction of the displacement of the default listening position from the user.

### Claim 24 (depends on 16)

The apparatus of claim 16 wherein, in response to a trigger event, the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
move at least one of the first or the second audio content closer to at least one of the device or the default listening position.

### Claim 25 (depends on 24)

The apparatus of claim 24 wherein the at least one of the first or second audio content is moved to one of:
a position corresponding to the device;
a position corresponding to the default listening position; or
respective positions corresponding to respective default positions of the first or the second audio content translated by the displacement of the default listening position from the user, the respective default positions of the first or second audio content corresponding to spatial information comprised in the input audio signal.

### Claim 26 (depends on 24)

The apparatus of claim 24 wherein if the distance between the user and the default listening position does not decrease in response to the movement of one of the first or the second audio content, the other of the first or the second audio content is moved closer to at least one of the device or the default listening position.

### Claim 27 (depends on 16)

The apparatus of claim 16 wherein audio content comprised in the input audio signal is divided into at least:
a first group, which comprises the first audio content; and
a second group which comprises the second audio content,
wherein a spatial audio modification applied to the first audio content, is also applied to other audio content of the first group, and
wherein a spatial audio modification applied to the second audio content, is also applied to other audio content of the second group.

### Claim 28 (depends on 27)

The apparatus of claim 27 wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
based on at least one of: one or more audio content descriptors or spatial information regarding the audio content, selectively assign audio content to the first or second group.

### Claim 29

A method comprising:
obtaining an input audio signal comprising at least first audio content and second audio content;
rendering an output audio signal with the first audio content and the second audio content spatialized in an audio scene; and
in response to an increase in distance, in the real world, between a user and a default listening position relative to a device, increasing a distance, within the audio scene, between the first audio content and the second audio content.

### Claim 30 (depends on 29)

The method of claim 29 further comprising:
in response to a trigger event, moving at least one of the first audio content or the second audio content closer to at least one of the device or the default listening position.

### Claim 31 (depends on 29)

The method of claim 29, wherein audio content comprised in the input audio signal is divided into at least:
a first group, which comprises the first audio content; and
a second group which comprises the second audio content,
wherein a spatial audio modification applied to the first audio content, is also applied to other audio content of the first group, and
wherein a spatial audio modification applied to the second audio content, is also applied to other audio content of the second group.

### Claim 32

A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:
causing an input audio signal comprising at least first audio content and second audio content to be obtained;
causing an output audio signal to be rendered with the first audio content and the second audio content spatialized in an audio scene; and
in response to an increase in distance, in the real world, between a user and a default listening position relative to a device, causing an increase in a distance, within the audio scene, between the first audio content and the second audio content.

### Claim 33 (depends on 32)

The non-transitory computer readable medium of claim 32 wherein the second audio content has a default position corresponding to spatial information comprised in the input audio signal, and wherein increasing the distance, within the audio scene, between the first and second audio content comprises displacement of the second audio content from its default position within the audio scene.

### Claim 34 (depends on 32)

The non-transitory computer readable medium of claim 32, wherein the program instructions are further configured to cause:
in response to a trigger event, moving at least one of the first audio content or the second audio content closer to at least one of the device or the default listening position.

### Claim 35 (depends on 32)

The non-transitory computer readable medium of claim 32, wherein audio content comprised in the input audio signal is divided into at least:
a first group, which comprises the first audio content; and
a second group which comprises the second audio content,
wherein a spatial audio modification applied to the first audio content, is also applied to other audio content of the first group, and
wherein a spatial audio modification applied to the second audio content, is also applied to other audio content of the second group.
