# US 2020/0395022 A1 · Layered coding for compressed sound or sound field represententations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0395022 A1
- Document ID: US20200395022A1
- Status: Published application
- Kind: A1
- Application number: 16/917,907
- Filed: 2020-07-01
- Published: 2020-12-17
- Earliest claimed: 2015-10-08
- Assignees: Dolby International AB
- Applicants: Dolby International AB
- Inventors: Sven KORDON; Alexander KRUEGER
- Web page: https://patentgrep.com/patent/US20200395022A1

## CPC

- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/24: Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
- H04S 7/00: Indicating arrangements; Control arrangements, e.g. balance control
- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

The present document relates to a method of layered encoding of a compressed sound representation of a sound or sound field. The compressed sound representation comprises a basic compressed sound representation comprising a plurality of components, basic side information for decoding the basic compressed sound representation to a basic reconstructed sound representation of the sound or sound field, and enhancement side information including parameters for improving the basic reconstructed sound representation. The method comprises sub-dividing the plurality of components into a plurality of groups of components and assigning each of the plurality of groups to a respective one of a plurality of hierarchical layers, the number of groups corresponding to the number of layers, and the plurality of layers including a base layer and one or more hierarchical enhancement layers, adding the basic side information to the base layer, and determining a plurality of portions of enhancement side information from the enhancement side information and assigning each of the plurality of portions of enhancement side information to a respective one of the plurality of layers, wherein each portion of enhancement side information includes parameters for improving a reconstructed sound representation obtainable from data included in the respective layer and any layers lower than the respective layer. The document further relates to a method of decoding a compressed sound representation of a sound or sound field, wherein the compressed sound representation is encoded in a plurality of hierarchical layers that include a base layer and one or more hierarchical enhancement layers, as well as to an encoder and a decoder for layered coding of a compressed sound representation.

## Claims

### Claim 1

A method of decoding a compressed Higher Order Ambisonics (HOA) representation of a sound or sound field, the method comprising:
receiving a bit stream containing the compressed HOA representation corresponding to a plurality of hierarchical layers that include a base layer and two or more hierarchical enhancement layers, and containing basic side information that is associated with the base layer and enhancement side information that is associated with the two or more hierarchical enhancement layers,
wherein a plurality of layers have assigned thereto components of a basic compressed sound representation of the sound or sound field, the components being assigned to respective layers in respective groups of components, wherein the components of the basic compressed sound representation correspond to monaural signals and the monaural signals represent either predominant sound signals or coefficient sequences of an HOA representation,
wherein the two or more hierarchical enhancement layers comprises a highest usable hierarchical enhancement layer, and
wherein each of the two or more hierarchical enhancement layers includes a portion of the enhancement side information including parameters for improving a basic reconstructed sound representation obtainable from data included in a respective layer and any layers lower than the respective layer; and
decoding the compressed HOA representation based on the basic side information that is associated with the base layer, based on the portion of the enhancement side information that is associated with the highest usable hierarchical enhancement layer, and not based on the portion of the enhancement side information that is associated with any other layer of the two or more hierarchical enhancement layers.

### Claim 2 (depends on 1)

The method of claim 1, wherein the enhancement side information includes parameters related to at least one of: spatial prediction, sub-band directional signals synthesis, and parametric ambience replication.

### Claim 3 (depends on 1)

The method of claim 1, wherein the enhancement side information includes information that allows prediction of missing portions of the sound or sound field from directional signals.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining, for each layer, whether the respective layer has been validly received; and
determining a layer index of a layer immediately below a lowest layer that has not been validly received.

### Claim 5 (depends on 4)

The method of claim 4, further comprising determining a further layer index that is either equal to the layer index or that indicates omission of enhancement side information during decoding.

### Claim 6 (depends on 1)

The method of claim 1, wherein the base layer includes at least one portion of additional basic side information corresponding to the respective layer and including information that specifies decoding of one or more components among the components assigned to the respective layer in dependence on other components assigned to the respective layer and any layers lower than the respective layer, the method further comprising, for each portion of additional basic side information:
decoding the portion of additional basic side information by referring to the components assigned to its respective layer and any layers lower than the respective layer; and
correcting the portion of additional basic side information by referring to the components assigned to the highest usable hierarchical enhancement layer and any layers between the highest usable hierarchical enhancement layer and the respective layer,
wherein the basic reconstructed sound representation is obtained from the components assigned to the highest usable hierarchical enhancement layer and any layers lower than the highest usable hierarchical enhancement layer, using the basic side information and corrected portions of additional basic side information obtained from portions of additional basic side information corresponding to layers up to the highest usable hierarchical enhancement layer.

### Claim 7 (depends on 1)

A non-transitory computer readable medium containing instructions that when executed by a processor perform the method of claim 1.

### Claim 8

An apparatus for decoding a compressed Higher Order Ambisonics (HOA) representation of a sound or sound field, the apparatus comprising:
a receiver for receiving a bit stream containing the compressed HOA representation corresponding to a plurality of hierarchical layers that include a base layer and two or more hierarchical enhancement layers, and containing basic side information that is associated with the base layer and enhancement side information that is associated with the two or more hierarchical enhancement layers,
wherein a plurality of layers have assigned thereto components of a basic compressed sound representation of the sound or sound field, the components being assigned to respective layers in respective groups of components,
wherein the components of the basic compressed sound representation correspond to monaural signals and the monaural signals represent either predominant sound signals or coefficient sequences of an HOA representation,
wherein the two or more hierarchical enhancement layers comprises a highest usable hierarchical enhancement layer, and
wherein each of the two or more hierarchical enhancement layers includes a portion of the enhancement side information including parameters for improving a basic reconstructed sound representation obtainable from data included in a respective layers and any layers lower than the respective layer; and
a decoder for decoding the compressed HOA representation based on the basic side information that is associated with the base layer, based on the portion of the enhancement side information that is associated with the highest usable hierarchical enhancement layer, and not based on the portion of the enhancement side information that is associated with any other layer of the two or more hierarchical enhancement layers.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the enhancement side information includes parameters related to at least one of: spatial prediction, sub-band directional signals synthesis, and parametric ambience replication.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the enhancement side information includes information that allows prediction of missing portions of the sound or sound field from directional signals.

### Claim 11 (depends on 8)

The apparatus of claim 8, configured to:
determine, for each layer, whether the respective layer has been validly received; and
determine a layer index of a layer immediately below a lowest layer that has not been validly received.

### Claim 12 (depends on 11)

The apparatus of claim 11, further configured to determine a further layer index that is either equal to the layer index or that indicates omission of enhancement side information during decoding.

### Claim 13 (depends on 8)

The apparatus of claim 8,
wherein the base layer includes at least one portion of additional basic side information corresponding to the respective layer and including information that specifies decoding of one or more components among the components assigned to the respective layer in dependence on other components assigned to the respective layer and any layers lower than the respective layer, and
wherein for each portion of additional basic side information, the apparatus is configured to:
decode the portion of additional basic side information by referring to the components assigned to its respective layer and any layers lower than the respective layer; and
correct the portion of additional basic side information by referring to the components assigned to the highest usable hierarchical enhancement layer and any layers between the highest usable hierarchical enhancement layer and the respective layer,
wherein the basic reconstructed sound representation is obtained from the components assigned to the highest usable hierarchical enhancement layer and any layers lower than the highest usable hierarchical enhancement layer, using the basic side information and corrected portions of additional basic side information obtained from portions of additional basic side information corresponding to layers up to the highest usable hierarchical enhancement layer.
