Back to results
US 11,146,903 B2Granted
Compression of decomposed representations of a sound field
AssigneeQUALCOMM Incorporated
InventorsDipanjan Sen, Sang-Uk Ryu
Life of this patent
Estimating the term…
Abstract
In general, techniques are described for compressing decomposed representations of a sound field. A device comprising one or more processors may be configured to perform the techniques. The one or more processors may be configured to obtain a bitstream comprising a compressed version of a spatial component of a sound field, the spatial component generated by performing a vector based synthesis with respect to a plurality of spherical harmonic coefficients.
Claims49
A method comprising:
- obtaining, by an audio decoding device, a bitstream comprising a compressed version of a spatial component, in an audio frame, of a sound field, and a compressed version of a predominant signal in the audio frame, wherein the predominant signal and the spatial component are characterized by wherein the predominant signal and the spatial component having been generated, at an encoding device, by a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients, wherein the value decomposition generated a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents the spatial component, and wherein the U matrix multiplied by the S matrix includes one or more vectors that represent the predominant signal, and wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- decompressing, by the audio decoding device, the compressed version of the predominant signal to generate a reconstructed predominant signal;
- decompressing, by the audio decoding device, the spatial component to generate a reconstructed spatial component;
- rendering, by the audio decoding device, one or more speaker feeds based on the reconstructed spatial component and the reconstructed predominant signal;
- and
- outputting, by the audio decoding device, the one or more speaker feeds to one or more speakers.
3 more elements
An audio decoding device comprising:
- a memory configured to store a bitstream comprising a compressed version of a spatial component, in an audio frame, of a sound field, and a compressed version of a predominant signal in the audio frame, wherein the predominant signal and the spatial component are characterized by wherein the predominant signal and the spatial component having been generated, at an encoding device, by a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients, wherein the value decomposition generated a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents the spatial component, the spatial component defined in a spherical harmonic domain, and wherein the U matrix multiplied by the S matrix includes one or more vectors that represent the predominant signal, wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- and
- one or more processors coupled to the memory, and configured to:
- decompress the compressed version of the predominant signal to generate a reconstructed predominant signal;
- decompress the spatial component to generate a reconstructed spatial component;
- and
- render one or more speaker feeds based on the reconstructed spatial component and the reconstructed predominant signal.
4 more elements
A device comprising:
- means for obtaining a bitstream comprising a compressed version of a spatial component, in an audio frame, of a sound field, and a compressed version of a predominant signal in the audio frame, wherein the predominant signal and the spatial component are characterized by wherein the predominant signal and the spatial component having been generated, at an encoding device, by a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients, wherein the value decomposition generated a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents the spatial component, the spatial component defined in a spherical harmonic domain, and wherein the U matrix multiplied by the S matrix includes one or more vectors that represent the predominant signal, and wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- means for storing the bitstream;
- means for decompressing the compressed version of the predominant signal to generate a reconstructed predominant signal;
- means for decompressing the spatial component to generate a reconstructed spatial component;
- means for rendering one or more speaker feeds based on the reconstructed spatial component and the reconstructed predominant signal;
- and
- means for outputting the one or more speaker feeds to one or more speakers.
4 more elements
A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more processors to;
- obtain a bitstream comprising a compressed version of a spatial component, in an audio frame, of a sound field, and a compressed version of a predominant signal in the audio frame, wherein the predominant signal and the spatial component are characterized by wherein the predominant signal and the spatial component having been generated, at an encoding device, by a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients, wherein the value decomposition generated a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents the spatial component, the spatial component defined in a spherical harmonic domain, and wherein the U matrix multiplied by the S matrix includes one or more vectors that represent the predominant signal, wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- decompress the compressed version of the predominant signal to generate a reconstructed predominant signal;
- decompress the spatial component to generate a reconstructed spatial component;
- render one or more speaker feeds based on the reconstructed spatial component and the reconstructed predominant signal;
- and
- output the one or more speaker feeds to one or more speakers.
3 more elements
A method comprising:
- performing, by an audio encoding device, a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients, wherein the value decomposition generates a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents a spatial component, the spatial component defined in a spherical harmonic domain, and wherein the U matrix multiplied by the S matrix includes one or more vectors that represent the predominant signal, wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- compressing, by the audio encoding device, the spatial component to generate a compressed version of the spatial component;
- compressing, by the audio encoding device, the predominant signal, to generate a compressed version of the predominant signal;
- and
- generating, by the audio encoding device, a bitstream comprising the compressed version of the spatial component and the compressed version of the predominant signal.
2 more elements
A device comprising:
- a memory configured to store a plurality of spherical harmonic coefficients;
- and
- one or more processors coupled to the memory, and configured to:
- perform a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients wherein the value decomposition generates a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents a spatial component, the spatial component defined in a spherical harmonic domain, wherein the U matrix multiplied by the S matrix includes one or more vectors that represent a predominant signal, and wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- compress the spatial component to generate a compressed version of the spatial component;
- compress the predominant signal, to generate a compressed version of the predominant signal;
- and
- generate a bitstream comprising the compressed version of the spatial component, and the compressed version of the predominant signal.
5 more elements
A device comprising:
- means for performing a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients wherein the value decomposition generates a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents a spatial component, the spatial component defined in a spherical harmonic domain, wherein the U matrix multiplied by the S matrix includes one or more vectors that represent a predominant signal, and wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- means for compressing the spatial component;
- means for compressing the predominant signal, to generate a compressed version of the predominant signal;
- means for generating a bitstream comprising the compressed version of the spatial component and the compressed version of the predominant signal;
- and
- means for storing the bitstream.
3 more elements
A non-transitory computer-readable storage medium comprising instructions that when executed cause one or more processors to:
- perform a value decomposition of a matrix that includes a plurality of spherical harmonic coefficients wherein the value decomposition generates a product of three matrices, U, S, and V, wherein the V matrix includes a plurality of V vectors, and at least one V vector represents a spatial component, the spatial component defined in a spherical harmonic domain, wherein the U matrix multiplied by the S matrix includes one or more vectors that represent a predominant signal, and wherein the predominant signal includes one or more audio objects also defined in the spherical harmonic domain;
- compress the spatial component;
- compress the predominant signal, to generate a compressed version of the predominant signal;
- and
- generate a bitstream comprising the compressed version of the spatial component, and the compressed version of the predominant signal, wherein the compressed version of the spatial component is represented in the bitstream.
2 more elements
Dependencies are inferred from the claim text.