Back to results
US 12,701,379 B2Granted
Audio scene description and control
AssigneeApple Inc.
InventorsFrank Baumgarte, Moo Young Kim, Dipanjan Sen, Sang Uk Ryu
Life of this patent
Estimating the term…
Abstract
A data structure stored in memory includes a scene description that defines a hierarchy of scene components that are in digital audio content received from a producer. The hierarchy has several stages including a fourth stage in which a scene composition is defined that contains all scene components needed to render the digital audio content in a single presentation, for instance as intended by the producer, and for input to a spatial audio renderer, wherein the scene composition contains one or more composition selection groups. Other aspects are also described and claimed.
Claims21
A method for processing digital audio content for input to a spatial audio renderer, the method comprising:
- receiving digital audio content from a producer, wherein the digital audio content comprises a plurality of scene components and a scene description, and the scene description defines a hierarchy of the plurality of scene components, the hierarchy comprising:
- a first stage in which each of the plurality of scene components is grouped into either a language-specific item or a non-language item, not both, wherein there is at least two language-specific items or at least two non-language items in the first stage,
- a second stage in which all language-specific items are members of one but not necessarily a same language selection set, there being one or more language selection sets,
- a third stage in which one or more of the language selection sets are grouped into a composition selection group, and two or more of the non-language items are grouped into the same composition selection group or another composition selection group, wherein of all items that are in a single composition selection group no more than one is active at a time, and
- a fourth stage in which a scene composition is defined that contains all of the plurality of scene components needed to render the digital audio content in a single presentation, for input to the spatial audio renderer, wherein the scene composition contains one or more of the composition selection groups;
- and
- modifying at least some of the scene components in accordance with the scene description and in accordance with a user input to produce modified scene components for input to the spatial audio renderer.
4 more elements
A memory for storing data for access by an application program being executed by a computer for processing digital audio content for input to a spatial audio renderer, the memory comprising:
- a data structure stored in the memory, the data structure including a scene description that defines a hierarchy of a plurality of scene components that are in digital audio content from a producer, the hierarchy comprising:
- a first stage in which each of the plurality of scene components is grouped into either a language-specific item or a non-language item, not both, wherein there is at least two language-specific items or at least two non-language items in the first stage,
- a second stage in which all language-specific items are members of one but not necessarily a same language selection set, there being one or more language selection sets,
- a third stage in which one or more of the language selection sets are grouped into a composition selection group, and two or more of the non-language items are grouped into the same composition selection group or another composition selection group, wherein of all items that are in a single composition selection group no more than one is active at a time, wherein an item is active when it is to be rendered in a single presentation of the digital audio content, and
- a fourth stage in which a scene composition is defined that contains all of the plurality of scene components needed to render the digital audio content in the single presentation, for input to the spatial audio renderer, wherein the scene composition contains one or more composition selection groups.
2 more elements
A playback system for processing digital audio content, the playback system comprising:
- a processor;
- and
- memory having stored therein instructions that configure the processor to
- receive digital audio content from a producer, wherein the digital audio content comprises a plurality of scene components and a scene description, and the scene description defines a hierarchy of the plurality of scene components, the hierarchy comprising:
- a first stage in which each of the plurality of scene components is grouped into either a language-specific item or a non-language item, not both, wherein there is at least two language-specific items or at least two non-language items in the first stage,
- a second stage in which all of the language-specific items are members of one but not necessarily a same language selection set, there being one or more language selection sets,
- a third stage in which one or more of the language selection sets are grouped into a composition selection group, and two or more of the non-language items are grouped into said composition selection group or another composition selection group, wherein of all items that are in a single composition selection group no more than one is active at a time, and
- a fourth stage in which a scene composition is defined that contains all of the plurality of scene components needed to render the digital audio content in a single presentation, for input to a spatial audio renderer, wherein the scene composition contains one or more of the composition selection groups;
- and
- modify at least some of the plurality of scene components in accordance with the scene description and in accordance with a user input to produce modified scene components for input to the spatial audio renderer.
7 more elements
Dependencies are inferred from the claim text.