Specifying spherical harmonic and/or higher order ambisonics coefficients in bitstreams
AssigneeQUALCOMM Incorporated
InventorsDipanjan Sen, Martin James Morrell
Life of this patent
Estimating the term…
Abstract
In general, techniques are described for specifying spherical harmonic coefficients in a bitstream. A device comprising one or more processors may perform the techniques. The processors may be configured to identify, from the bitstream, a plurality of hierarchical elements describing a sound field that are included in the bitstream. The processors may further be configured to parse the bitstream to determine the identified plurality of hierarchical elements.
Claims32
A method of generating a bitstream representative of a compressed version of audio content, the method comprising:
- obtaining, by a processor of a device, a plurality of spherical harmonic coefficients representative of the audio content;
- determining, by the processor and based on an analysis of the plurality of spherical harmonic coefficients, whether one or more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions, wherein the plurality of spherical harmonic coefficients are representative of the sound field;
- specifying an indication, in the bitstream stored to a memory of the device and by the processor, identifying that the determined one or more of the plurality of spherical harmonic coefficients having the information relevant in describing the sound field are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field are not included in the bitstream;
- specifying, in the bitstream and by the processor, the identified one or more of the plurality of spherical harmonic coefficients without specifying, in the bitstream, the remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field;
- determining, by the processor, a target bitrate for the bitstream including the identified one or more of the plurality of spherical harmonic coefficients;
- and
- bandwidth compressing, by the processor and according to the determined target bitrate, the identified one or more of the plurality of spherical harmonic coefficients in the bitstream.
A device configured to generate a bitstream representative of a compressed version of audio content, the device comprising:
- one or more processors configured to:
- obtain a plurality of spherical harmonic coefficients representative of the audio content;
- determine, based on an analysis of the plurality of spherical harmonic coefficients, whether one or more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions, wherein the plurality of spherical harmonic coefficients are representative of the sound field;
- specify an indication, in the bitstream, identifying that the determined one or more of the plurality of spherical harmonic coefficients having the information relevant in describing the sound field are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field are not included in the bitstream;
- specify, in the bitstream, the identified one or more of the plurality of spherical harmonic coefficients without specifying, in the bitstream, the remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field;
- determine a target bitrate for the bitstream including the identified one or more of the plurality of spherical harmonic coefficients;
- and
- bandwidth compress, according to the determined target bitrate, the identified one or more of the plurality of spherical harmonic coefficients in the bitstream;
- and
- a memory coupled to the one or more processors, and configured to store at least a portion of the bitstream.
A device configured to generate a bitstream representative of a compressed version of audio content, the device comprising:
- means for obtaining a plurality of spherical harmonic coefficients representative of the audio content;
- means for determining, based on an analysis of the plurality of spherical harmonic coefficients, whether one or more of a plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions, wherein the plurality of spherical harmonic coefficients are representative of the sound field;
- means for specifying, in the bitstream, an indication identifying that the determined one or more of the plurality of spherical harmonic coefficients having the information relevant in describing the sound field are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field are not included in the bitstream;
- means for specifying, in the bitstream, the identified one or more of the plurality of spherical harmonic coefficients without specifying, in the bitstream, the remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field
- means for determining, by the processor, a target bitrate for the bitstream including the identified one or more of the plurality of spherical harmonic coefficients;
- and
- means for bandwidth compressing, by the processor and according to the determined target bitrate, the identified one or more of the plurality of spherical harmonic coefficients in the bitstream.
A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:
- obtain a plurality of spherical harmonic coefficients representative of audio content;
- determine, based on an analysis of the plurality of spherical harmonic coefficients, whether one or more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions, wherein the plurality of spherical harmonic coefficients are representative of the sound field;
- specify, in a bitstream, an indication identifying that only the determined one or more of the plurality of spherical harmonic coefficients having the information relevant in describing the sound field are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field are not included in the bitstream;
- specify, in the bitstream, the identified one or more of the plurality of spherical harmonic coefficients without specifying, in the bitstream, the remaining ones of the plurality of spherical harmonic coefficients having information not relevant in describing the sound field
- determine a target bitrate for the identified one or more of the plurality of spherical harmonic coefficients;
- and
- bandwidth compress, according to the determined target bitrate, the identified one or more of the plurality of spherical harmonic coefficients.
A method of processing a bitstream representative of a compressed version of audio content, the method comprising:
- bandwidth decompressing, by one or more processors, a compressed version of one or more of a plurality of spherical harmonic coefficients specified in the bitstream to obtain the one or more of the plurality of spherical harmonic coefficients, wherein the one or more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions;
- identifying, by the one or more processors and from the bitstream, that the one or more of the plurality of spherical harmonic coefficients are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients determined to have information not relevant in describing the sound field in three dimensions are not included in the bitstream, wherein the plurality of spherical harmonic coefficients are representative of the audio content, and the bitstream is formed to achieve a target bitrate;
- parsing, by the one or more, the bitstream to determine the identified one or more of the plurality of spherical harmonic coefficients and not the remaining ones of the plurality of spherical harmonic coefficients;
- render, by the one or more processors, the plurality of spherical harmonic coefficients to one or more speaker feeds;
- and
- output, by the one or more processors, the one or more speaker feeds to one or more speakers.
A device configured to process a bitstream representative of a compressed version of audio content, the device comprising:
- a memory configured to store at least a portion of the bitstream;
- and
- one or more processors configured to:
- bandwidth decompress a compressed version of one or more of a plurality of spherical harmonic coefficients specified in the bitstream to obtain one or more of a plurality of spherical harmonic coefficients, wherein the one of more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions;
- identify, from the bitstream, that the one or more of the plurality of spherical harmonic coefficients are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients determined to have information not relevant in describing the sound field in three dimensions are not included in the bitstream, wherein the plurality of spherical harmonic coefficients are representative of the audio content, and the bitstream is formed to achieve a target bitrate;
- parse the bitstream to determine the identified one or more of the plurality of spherical harmonic coefficients and not the remaining ones of the plurality of spherical harmonic coefficients;
- render the plurality of spherical harmonic coefficients to one or more speaker feeds;
- and
- output the one or more speaker feeds to one or more speakers.
A device configured to process a bitstream representative of a compressed version of audio content, the device comprising:
- means for bandwidth decompressing a compressed version of one or more of a plurality of spherical harmonic coefficients specified in the bitstream to obtain one or more of a plurality of spherical harmonic coefficients, wherein the one of more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions;
- means for identifying, from the bitstream, that the one or more of the plurality of spherical harmonic coefficients are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients determined to have information not relevant in describing the sound field in three dimensions are not included in the bitstream, wherein the plurality of spherical harmonic coefficients are representative of the audio content, and the bitstream is formed to achieve a target bitrate;
- means for parsing the bitstream to determine the identified one or more of the plurality of spherical harmonic coefficients and not the remaining ones of the plurality of spherical harmonic coefficients;
- render the plurality of spherical harmonic coefficients to one or more speaker feeds;
- and
- output the one or more speaker feeds to one or more speakers.
A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:
- bandwidth decompress a compressed version of one or more of a plurality of spherical harmonic coefficients specified in a bitstream to obtain one or more of a plurality of spherical harmonic coefficients, wherein the one of more of the plurality of spherical harmonic coefficients have information relevant in describing a sound field in three dimensions;
- identify, from the bitstream, that the one or more of the plurality of spherical harmonic coefficients are included in the bitstream, and that remaining ones of the plurality of spherical harmonic coefficients determined to have information not relevant in describing the sound field in three dimensions are not included in the bitstream, wherein the plurality of spherical harmonic coefficients are representative of the audio content, and the bitstream is formed to achieve a target bitrate;
- parse the bitstream to determine the identified one or more of the plurality of spherical harmonic coefficients and not the remaining ones of the plurality of spherical harmonic coefficients;
- render the plurality of spherical harmonic coefficients to one or more speaker feeds;
- and
- output the one or more speaker feeds to one or more speakers.
Dependencies are inferred from the claim text.