US 2020/0288258 A1 · FILE FORMAT FOR SPATIAL AUDIO

Abstract

An audio asset library containing audio assets formatted in accordance with a file format for spatial audio includes asset metadata that enables simulated reality (SR) application developers to compose sounds for use in SR applications. The audio assets are formatted to include audio data encoding a sound capable of being composed into a SR application along with asset metadata describing not only how the sound was encoded, but also how a listener in SR environment experiences the sound. A SR developer platform is configured so that developers can compose sound for SR objects using audio assets stored in the audio library, including editing the asset metadata to include transformation parameters that support dynamic transformation of the asset metadata in the SR environment to alter how the SR listener experiences the composed sound. Other embodiments are also described and claimed.

Claims23

Dependent claims

A computer-implemented method for creating an audio asset library of sounds for use in a simulated reality (SR) application, the method comprising:

receiving audio data that has encoded therein a sound;
receiving metadata describing how the sound is encoded;
creating an audio asset containing asset metadata and the audio data, the asset metadata including i) the received metadata and metadata describing how the sound is to be rendered as spatial audio through a SR application;
and
storing the audio asset in an audio asset library.

2 more elements

A computer-implemented method for composing sound for a simulated reality (SR) environment, the method comprising:

retrieving an audio asset stored in an audio library, wherein the audio asset contains audio data and asset metadata, the audio data having therein a sound encoded in accordance with or as specified in the asset metadata, the asset metadata further describing how the audio asset is to be rendered in a SR application;
and
composing the retrieved audio asset into the SR application, the composing including
previewing how the audio asset is to be rendered in the SR application in accordance with the asset metadata,
editing the audio asset to enable dynamic transformation of the asset metadata in the SR application to alter how the audio asset is rendered in the SR application, and
attaching the edited audio asset to a SR object in the SR application.

3 more elements

A computer-implemented method for processing sound in a simulated reality (SR) environment, the method comprising:

configuring a SR environment in accordance with a SR application, the SR application having a SR object to which an audio asset is attached, wherein the audio asset contains audio data and asset metadata, the audio data having therein a sound encoded in accordance with the asset metadata, the asset metadata having one or more transformation parameters for describing how the audio asset is to be rendered;
receiving a request to play the sound as encoded in the audio asset;
determining a relationship between a listener and the SR object to which the audio asset is attached, including any one or more of a location and orientation of the listener relative to the SR object in the SR environment, as provided by the SR application, wherein the location and orientation affects how the audio asset is to be rendered in the SR application;
setting one of the one or more transformation parameters of the asset metadata with the determined relationship between the listener and the SR object, wherein setting the transformation parameter dynamically transforms the asset metadata to alter how the audio asset is to be rendered through the SR application;
and
rendering the audio asset to a sound playback system in accordance with the SR application and in accordance with the transformed asset metadata.

3 more elements

Dependencies are inferred from the claim text.

File format for spatial audio

Life of this patent

File format for spatial audio

Life of this patent

Abstract

Claims23