US 9,805,725 B2 · Object clustering for rendering object-based audio content based on perceptual criteria

Abstract

Embodiments are directed a method of rendering object-based audio comprising determining an initial spatial position of objects having object audio data and associated metadata, determining a perceptual importance of the objects, and grouping the audio objects into a number of clusters based on the determined perceptual importance of the objects, such that a spatial error caused by moving an object from an initial spatial position to a second spatial position in a cluster is minimized for objects with a relatively high perceptual importance. The perceptual importance is based at least in part by a partial loudness of an object and content semantics of the object.

Claims20

Dependent claims

A method of compressing object-based audio data comprising:

determining a perceptual importance of objects in an audio scene, wherein the objects comprise object audio data and associated metadata;
combining certain audio objects into clusters of audio objects based on the determined perceptual importance of the audio objects, wherein a number of clusters is less than an original number of audio objects in the audio scene, and wherein said combining certain audio objects into clusters comprises selecting centroids for the clusters that correspond to the audio objects having the highest perceptual importance and distributing at least one of the remaining audio objects over more than one of the clusters by panning techniques.

A method of processing object-based audio comprising:

determining a first spatial location of each audio object relative to the other audio objects of the plurality of audio objects;
determining a relative importance of each audio object of the plurality of audio objects, said relative importance depending on the relative spatial locations of audio objects, by at least determining a partial loudness of each audio object of the plurality of audio objects, wherein the partial loudness of an audio object is based at least in part on a masking effect of one or more other audio objects;
determining a number of centroids, each centroid comprising a center of a cluster for grouping a plurality of audio objects, the centroid positions being dependent on the relative importance of one or more audio objects;
combining waveforms embodying the audio data for constituent audio objects within the same cluster together to form a replacement audio object having a combined waveform of the constituent audio objects;
and
combining the metadata for the constituent audio objects within the same cluster Nether to form a replacement set of metadata for the constituent audio objects.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application

14/654,460Filed 25 Nov 2013 · us provisional application

Priority

21 Dec 2012

Published

US 2015/0332680 A119 Nov 2015

Granted

31 Oct 2017

Term ends

Not estimatedThe source records don’t support an estimate.

Classification9 codes

G10L 19/008
Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals,…:…
G10L 19/02
Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals,…:…
G10L 19/20
Vocoders using multiple modes: using sound class specific coding, hybrid encoders or object based coding
G10L 25/18
Characterised by the type of extracted parameters: the extracted parameters being spectral information of each sub-band

Object clustering for rendering object-based audio content based on perceptual criteria

Life of this patent

Object clustering for rendering object-based audio content based on perceptual criteria

Life of this patent

Abstract

Claims20