# US 2021/0343296 A1 · Apparatus, Methods and Computer Programs for Controlling Band Limited Audio Objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343296 A1
- Document ID: US20210343296A1
- Status: Published application
- Kind: A1
- Application number: 17/261,633
- Filed: 2019-07-19
- Published: 2021-11-04
- Earliest claimed: 2018-07-24
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Miikka VILERMO; Mikko TAMMI; Mikko-Ville LAITINEN; Jussi VIROLAINEN; Juha VILKAMO
- Web page: https://patentgrep.com/patent/US20210343296A1

## CPC

- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04S 7/304: {For headphones}
- G10L 19/16: Vocoder architecture
- G10L 19/20: using sound class specific coding, hybrid encoders or object based coding
- H04S 7/303: {Tracking of listener position or orientation}
- H04S 7/305: {Electronic adaptation of stereophonic audio signals to reverberation of the listening space (H04S7/301 takes precedence)}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

The application relates to apparatus, methods and computer programs for controlling band limited audio objects. The example apparatus includes circuitry configured for: obtaining a band limited audio object comprising one or more parameters; obtaining spatial metadata associated with the band limited audio object; determining a position of a user; and using the determined position of the user and the spatial metadata associated with the band limited audio object to control at least one of the parameters of the band limited audio object.

## Claims

### Claim 1

An apparatus comprising processing circuitry, and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, cause the apparatus to:
obtain a band limited audio object comprising one or more parameters;
obtain spatial metadata associated with the band limited audio object;
determine a position of a user; and
use the determined position of the user and the spatial metadata associated with the band limited audio object to control at least one of the parameters of the band limited audio object.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

An apparatus as claimed in claim 1, wherein the spatial metadata is at least one of:
obtained with the band limited audio signal; or
stored with a non-band limited audio object and the band limited audio object is obtained with metadata indicative of the non-band limited audio object.

### Claim 4 (depends on 3)

An apparatus as claimed in claim 3, wherein the metadata obtained with the band limited audio object is indicative of a connection between the band limited audio object and the non-band limited audio object.

### Claim 5 (depends on 3)

An apparatus as claimed in claim 3, wherein the band limited audio object and the non-band limited audio object are configured to be played back at the same time.

### Claim 6

(canceled)

### Claim 7 (depends on 1)

An apparatus as claimed in claim 1, wherein the band limited audio object comprises at least one of:
a low frequency effect audio object;
a band limited audio object playback volume; or
a band limited audio object playback signal.

### Claim 8 (depends on 1)

An apparatus as claimed in claim 1, wherein the band limited audio object is configured to be played back via at least one band limited speaker.

### Claim 9 (depends on 1)

An apparatus as claimed in claim 1, wherein the one or more parameters comprise at least one of: volume; delay; reverberation; or diffusivity.

### Claim 10 (depends on 1)

An apparatus as claimed in claim 1, wherein the apparatus is configured such that the determined position of the user causes the apparatus to at least one of:
determine the position of the user while the band limited audio object is being played back;
determine the position of the user while one or more speakers configured to play back the band limited audio object; or
determine a distance between the user and the one or more speakers configured to playback the band limited audio object.

### Claim at position 11

-13. (canceled)

### Claim 14

A method comprising:
obtaining a band limited audio object comprising one or more parameters;
obtaining spatial metadata associated with the band limited audio object;
determining a position of a user; and
using the determined position of the user and the spatial metadata associated with the band limited audio object to control at least one of the parameters of the band limited audio object.

### Claim 15

(canceled)

### Claim 16 (depends on 14)

A method as claimed in claim 14, wherein the spatial metadata is at least one of:
obtained with the band limited audio signal; or
stored with a non-band limited audio object and the band limited audio object is obtained with metadata indicative of the non-band limited audio object.

### Claim 17

An apparatus comprising processing circuitry, and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, cause the apparatus to:
obtain a band limited audio object comprising one or more parameters;
obtain spatial metadata associated with the band limited audio object;
determine a direction of a display associated with the band limited audio object; and
use the spatial metadata associated with the band limited audio object to control one or more parameters of the band limited audio object in accordance with the determined direction of the display.

### Claim 18 (depends on 17)

An apparatus as claimed in claim 17, wherein the one or more parameters comprises a volume of the band limited audio object.

### Claim 19 (depends on 17)

An apparatus as claimed in claim 17, wherein the apparatus is configured such that the determined direction of the display causes the apparatus to determine whether the display is oriented within a threshold angular range wherein the threshold angular range is defined with the spatial metadata.

### Claim 20 (depends on 19)

An apparatus as claimed in claim 19, wherein the apparatus is configured to cause to at least one of:
control the one or more parameters of the band limited audio object in a first way when the display is oriented within the threshold angular range; or
control the one or more parameters of the band limited audio object in a second way if the display is not oriented within the threshold angular range.

### Claim 21

A method comprising:
obtaining a band limited audio object comprising one or more parameters;
obtaining spatial metadata associated with the band limited audio object;
determining a direction of a display associated with the band limited audio object; and
using the spatial metadata associated with the band limited audio object to control one or more parameters of the band limited audio object in accordance with the determined direction of the display.

### Claim 22 (depends on 21)

A method as claimed in claim 21, wherein the one or more parameters comprises a volume of the band limited audio object.

### Claim 23 (depends on 16)

A method as claimed in claim 16, wherein the metadata obtained with the band limited audio object is indicative of a connection between the band limited audio object and the non-band limited audio object.

### Claim 24 (depends on 16)

A method as claimed in claim 16, wherein the band limited audio object and the non-band limited audio object are configured to be played back at the same time.

### Claim 25 (depends on 14)

A method as claimed in claim 14, wherein the one or more parameters comprise at least one of: volume; delay; reverberation; or diffusivity.

### Claim 26 (depends on 14)

A method as claimed in claim 14, wherein determining the position of the user comprising at least one of:
determining the position of the user while the band limited audio object is played back;
determining the position of the user while one or more speakers configured to play back the band limited audio object; or
determining a distance between the user and the one or more speakers configured to playback the band limited audio object.
