Signaling for rendering tools
AssigneeQUALCOMM Incorporated
InventorsMoo Young Kim, Nils Günther Peters, Dipanjan Sen, Siddhartha Goutham Swaminathan, S M Akramus Salehin, Jason Filos
Life of this patent
Estimating the term…
Abstract
An example audio decoding device includes a memory configured to store at least a portion of a coded audio bitstream; and one or more processors configured to: decode, based on the coded audio bitstream, a representation of a soundfield; decode, based on the coded audio bitstream, a syntax element indicating a selection of either a head-related transfer function (HRTF) or a binaural room impulse response (BRIR); and render, using the selected HRTF or BRIR, speaker feeds from the soundfield.
Claims17
An audio decoding device included in an extended reality (XR) headset, the audio decoding device comprising:
- a memory configured to store at least a portion of a coded audio bitstream;
- and
- one or more processors configured to:
- decode, based on the coded audio bitstream, a representation of a soundfield having multiple degrees of freedom;
- decode, based on the coded audio bitstream, a first syntax element indicating whether reverb is enabled or disabled;
- responsive to the first syntax element indicating that reverb is enabled:
- decode, based on the coded audio bitstream, a plurality of room reverb coefficient sets for a room, each of the room reverb coefficient sets corresponding to a different candidate listener position in the room;
- and
- select, based on data generated by one or more sensors of the XR headset, a particular room reverb coefficient set from the plurality of room reverb coefficient sets that corresponds to a translational position of the XR headset within the room;
- and
- render, by a multiple degree of freedom audio renderer and selectively using reverb based on the first syntax element and using the particular room reverb coefficient set, speaker feeds from the soundfield, wherein the XR headset includes a plurality of speakers driven via the rendered speaker feeds.
An audio encoding device comprising:
- a memory configured to store at least a portion of a coded audio bitstream;
- and
- one or more processors configured to:
- encode, in the coded audio bitstream, a representation of a soundfield having multiple degrees of freedom;
- encode, in metadata of the coded audio bitstream, a first syntax element indicating whether reverb is enabled or disabled when rendering the soundfield;
- and
- where the first syntax element indicates that reverb is enabled:
- encode, in on the coded audio bitstream, a plurality of room reverb coefficient sets for a room, each of the room reverb coefficient sets corresponding to a different candidate listener position in the room.
A non-transitory computer-readable storage medium storing instructions that, when executed, cause an audio decoding device to:
- decode, based on a coded audio bitstream, a representation of a soundfield having multiple degrees of freedom;
- decode, based on the coded audio bitstream, a first syntax element indicating whether reverb is enabled or disabled;
- responsive to the first syntax element indicating that reverb is enabled:
- decode, based on the coded audio bitstream, a plurality of room reverb coefficient sets for a room, each of the room reverb coefficient sets corresponding to a different candidate listener position in the room;
- and
- select, based on data generated by one or more sensors of an XR headset, a particular room reverb coefficient set from the plurality of room reverb coefficient sets that corresponds to a translational position of the XR headset within the room;
- and
- render, by a multiple degree of freedom audio renderer and selectively using reverb based on the first syntax element and using the particular room reverb coefficient set, speaker feeds from the soundfield, wherein the XR headset includes a plurality of speakers driven via the rendered speaker feeds.
Dependencies are inferred from the claim text.