# US 2020/0401364 A1 · Audio Scene Processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401364 A1
- Document ID: US20200401364A1
- Status: Published application
- Kind: A1
- Application number: 16/957,805
- Filed: 2018-12-03
- Published: 2020-12-24
- Earliest claimed: 2017-12-27
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Antti ERONEN; Jussi Artturi LEPPANEN; Sujeet Shyamsundar MATE; Arto LEHTINIEMI
- Web page: https://patentgrep.com/patent/US20200401364A1

## CPC

- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

From multiple audio objects in an audio scene, one or more audio objects of interest are identified. First audio signals associated with the plurality of objects are processed for provision to a user device. The processing may be based on a position of the user device in an audio scene. The processing may include combining the first audio signals associated with the audio objects to form combined first audio signals, modifying the amplitude of the combined first audio signals and limiting to a first level the maximum amplitude of the combined first audio signals. The processing also includes modifying the amplitude of one or more individual first audio signals, associated with the one or more audio objects of interest, the modifying the amplitude of one or more individual first audio signals being independent of that for the combined first audio signals.

## Claims

### Claim 1

An apparatus comprising:
at least one processor; and
at least one memory including computer program code,
the at least one memory and the computer program code configured, with the at least one processor, to cause the apparatus to perform operations comprising:
identifying, from a plurality of audio objects in an audio scene, one or more audio objects of interest;
processing first audio signals associated with the plurality of objects for provision to a user device, by:
combining first audio signals associated with at least some of the audio objects to form combined first audio signals;
modifying amplitude of the combined first audio signals and limiting to a first level a maximum amplitude of the combined first audio signals; and
modifying amplitude of one or more individual first audio signals, associated with the one or more audio objects of interest, said modifying the amplitude of one or more individual first audio signals being independent of that for the combined first audio signals.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured, with the at least one processor, to cause the apparatus to perform subsequently combining the combined first audio signals, subjected to the first level limiting, with the one or more individual first audio signals and providing the resultant signal to the user device.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processing the first audio signals further comprises:
in a first processing path, applying first dynamic range compression to the combined first audio signals; and
in a second processing path, applying individual second dynamic range compression to the one or more individual first audio signals respectively associated with the one or more objects of interest.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the processing the first audio signals further performs:
amplification in the first processing path to the first audio signals prior to combining; and
amplification in the second processing path after applying individual second dynamic range compression to the one or more individual first audio signals, the amplification being based on the distance of the user device from the one or more audio objects of interest.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the amplification is determined by the inverse distance of the user device from the one or more audio objects of interest.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein a plurality of objects of interest are identified by the identifying one or more audio objects of interest, and wherein second dynamic range compression, individually applied to each individual first audio signal by the processing first audio signals, has different dynamic range compression characteristics.

### Claim 7 (depends on 3)

The apparatus of claim 3, wherein the processing the first audio signals is configured such that the proportion of one or more first audio signals respectively associated with the one or more objects of interest is (i) decreased prior to combining and applying first dynamic range compression and (ii) simultaneously increased prior to applying individual second dynamic range compression to said one or more signals.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein processing the first audio signals is configured such that the combined first audio signals only comprise first audio signals associated with audio objects other than the one or more audio objects of interest.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the processing the first audio signals combines the audio signals by summing.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the one or more objects of interest are identified based on distance from the user device.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the one or more objects of interest are identified based on direction of movement of the user device relative to the objects.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the audio objects comprise virtual objects in a volumetric virtual scene.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the individual first audio signals are limited to a second maximum amplitude level, different from the first maximum amplitude level, and the difference between the first and second maximum amplitude levels adjust dynamically based on a position of the user device in the audio scene.

### Claim 14

A method comprising:
identifying, from a plurality of audio objects in an audio scene, one or more audio objects of interest;
processing first audio signals associated with the plurality of objects for provision to a user device, comprising:
combining the first audio signals associated with the audio objects to form combined first audio signals;
modifying amplitude of the combined first audio signals and limiting to a first level a maximum amplitude of the combined first audio signals; and
modifying amplitude of one or more individual first audio signals, associated with the one or more audio objects of interest, said modifying the amplitude of one or more individual first audio signals being independent of that for the combined first audio signals.

### Claim 15 (depends on 14)

The method of claim 14, further comprising subsequently combining the combined first audio signals, subjected to the first level limiting, with the one or more individual first audio signals and providing the resultant signal to the user device.

### Claim 16 (depends on 14)

The method of claim 14, wherein processing the first audio signals further comprises:
in a first processing path, applying first dynamic range compression to the combined first audio signals; and
in a second processing path, applying individual second dynamic range compression to the one or more individual first audio signals respectively associated with the one or more objects of interest.

### Claim 17 (depends on 16)

The method of claim 16, wherein processing the first audio signals further comprises:
amplifying, in the first processing path, the first audio signals prior to combining; and
amplifying, in the second processing path, after applying individual second dynamic range compression, the one or more individual first audio signals, wherein the amplifying in the second processing path is based on the distance of the user device from the one or more audio objects of interest.

### Claim 18 (depends on 17)

The method of claim 17, wherein the amplifying is determined by the inverse distance of the user device from the one or more audio objects of interest.

### Claim 19 (depends on 16)

The method of claim 16, wherein a plurality of objects of interest are identified by the identifying one or more audio objects of interest and wherein the second dynamic range compression, individually applied to each individual first audio signal, has different dynamic range compression characteristics for the respective individual first audio signals.

### Claim 20

A non-transitory computer readable medium comprising computer program code stored thereon, the computer readable medium and computer program code being configured to, when run on at least one processor:
to identify, from a plurality of audio objects in an audio scene, one or more audio objects of interest;
to process first audio signals associated with the plurality of objects for provision to a user device, comprising:
combining the first audio signals associated with the audio objects to form combined first audio signals;
modifying the amplitude of the combined first audio signals and limiting to a first level a maximum amplitude of the combined first audio signals; and
modifying amplitude of one or more individual first audio signals, associated with the one or more audio objects of interest, said modifying the amplitude of one or more individual first audio signals being independent of that for the combined first audio signals.
