# US 2022/0284910 A1 · Encoding and decoding ivas bitstreams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284910 A1
- Document ID: US20220284910A1
- Status: Published application
- Kind: A1
- Application number: 17/631,613
- Filed: 2020-07-30
- Published: 2022-09-08
- Earliest claimed: 2019-08-01
- Assignees: Dolby Laboratories Licensing Corporation
- Applicants: Dolby Laboratories Licensing Corporation
- Inventors: Rishabh Tyagi; Juan Felix Torres
- Web page: https://patentgrep.com/patent/US20220284910A1

## CPC

- G10L 19/032: Quantisation or dequantisation of spectral components
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 65/75: Media network packet handling
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Encoding/decoding an immersive voice and audio services (IVAS) bitstream comprises: encoding/decoding a coding mode indicator in a common header (CH) section of an IVAS bitstream, encoding/decoding a mode header or tool header in the tool header (TH) section of the bitstream, the TH section following the CH section, encoding/decoding a metadata payload in a metadata payload (MDP) section of the bitstream, the MDP section following the CH section, encoding/decoding an enhanced voice services (EVS) payload in an EVS payload (EP) section of the bitstream, the EP section following the CH section, and on the encoder side, storing or streaming the encoded bitstream, and on the decoder side, controlling an audio decoder based on the coding mode, the tool header, the EVS payload, and the metadata payload or storing a representation of same.

## Claims

### Claim 1

A method of generating a bitstream for an audio signal, comprising:
determining, using an immersive voice and audio services (IVAS) encoder, a coding mode indicator or coding tool indicator, the coding mode indicator or coding tool indicator indicating a coding mode or coding tool for the audio signal;
encoding, using the IVAS encoder, the coding mode indicator or coding tool indicator in a common header (CH) section of an IVAS bitstream;
determining, using the IVAS encoder, a mode header or tool header;
encoding, using the IVAS encoder, the mode or tool header in a tool header (TH) section of the IVAS bitstream, wherein the TH section follows the CH section;
determining, using the IVAS encoder, a metadata payload including spatial metadata;
encoding, using the IVAS encoder, the metadata payload in a metadata payload (MDP) section of the IVAS bitstream, where the MDP section follows the CH section; and
determining, using the IVAS encoder, an enhanced voice services (EVS) payload, the EVS payload including EVS coded bits for each channel or downmix channel of the audio signal; and
encoding, using the IVAS encoder, the EVS payload in an EVS payload (EP) section of the IVAS bitstream, where the EP section follows the CH section.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
storing the IVAS bitstream on a non-transitory computer-readable medium or streaming the IVAS bitstream to a downstream device, wherein the coding mode or coding tool indicator, the mode header or tool header, the metadata payload and the EVS payload are extracted and decoded from the, CH, TH, MDP and EP sections of the IVAS bitstream, respectively, for use in reconstruction of the audio signal on the downstream device or another device.

### Claim 3

A method of decoding a bitstream of an audio signal, comprising:
extracting and decoding, using an immersive voice and audio services (IVAS) decoder, a coding mode indicator or coding tool indicator in a common header (CH) section of an IVAS bitstream, the coding mode indicator or coding tool indicator indicating a coding mode or coding tool for the audio signal;
extracting and decoding, using the IVAS decoder, a mode header or tool header in the Tool Header (TH) section of the IVAS bitstream, the TH section following the CH section;
extracting and decoding, using the IVAS decoder, a metadata payload from metadata payload (MDP) section of the IVAS bitstream, the MDP section following the CH section, the metadata payload including spatial metadata; and
extracting and decoding, using the IVAS decoder, an enhanced voice services (EVS) payload from an EVS payload (EP) section of the IVAS bitstream, the EP section following the CH section, the EVS payload including EVS coded bits for each channel or downmix channel of the audio signal.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
controlling an audio decoder of a downstream device based on the coding mode indicator or coding tool indicator, the mode header or tool header, the EVS payload, and the metadata payload for use in reconstruction of the audio signal on the downstream device or another device, or storing a representation of the coding mode indicator or coding tool indicator, the mode header or tool header, the EVS payload, and the metadata payload on a non-transitory computer-readable medium.

### Claim 5 (depends on 3)

The method of claim 3, wherein the CH is a multi-bit data structure, where one value of the multi-bit data structure corresponding to a spatial reconstruction (SPAR) coding mode and other values of the data structure correspond to other coding modes.

### Claim 6 (depends on 3)

The method of claim 3, comprising storing in or reading from, respectively, the TH section of the IVAS bitstream, an index offset for computing a row index of a spatial reconstruction (SPAR) bitrate distribution control table.

### Claim 7 (depends on 3)

The method of claim 3, comprising storing in or reading from, respectively, the MDP section of the IVAS bitstream:
a quantization strategy indicator;
a bitstream coding strategy indicator; and
quantized and coded real and imaginary parts of a set of coefficients.

### Claim 8 (depends on 3)

The method of claim 3, wherein the EP section follows the MDP section to ensure efficient bitpacking, and a number of bits in the MDP section of the IVAS bitstream and a number of bits in the EP section of the IVAS bitstream vary in accordance with the SPAR bitrate distribution control table and a bitrate distribution algorithm to ensure that all available bits in an IVAS bitrate budget are utilized.

### Claim 9 (depends on 3)

The method of claim 3, wherein a bitrate for each EVS coded channel or downmix channel is determined by a total available bits for EVS, a bitrate distribution control table and a bitrate distribution algorithm.

### Claim 10 (depends on 3)

The method of claim 3, wherein the set of coefficients include prediction coefficients, direct coefficients, diagonal real coefficients and lower triangle complex coefficients.

### Claim 11 (depends on 10)

The method of claim 10, wherein the prediction coefficients are variable bit length based on entropy coding, and the direct coefficients, diagonal real coefficients and lower triangle complex coefficients are variable bit length based on a downmix configuration and entropy coding.

### Claim 12 (depends on 7)

The method of claim 7, wherein the quantization strategy indicator is a multi-bit data structure that indicates a quantization strategy.

### Claim 13 (depends on 7)

The method of claim 7, wherein the bitstream coding strategy indicator is a multi-bit data structure that indicates a number of bands of spatial metadata and a non-differential or time-differential entropy coding scheme.

### Claim 14 (depends on 7)

The method of claim 7, wherein the quantization of the coefficients is according to an EVS bitrate distribution control strategy that includes metadata quantization and an EVS bitrate distribution.

### Claim 15 (depends on 3)

The method of claim 3, comprising storing in or reading from, respectively, the EP section of the bitstream an EVS payload for EVS instances per third generation partnership project (3GPP) technical specification (TS) 26.445.

### Claim 16 (depends on 3)

The method of claim 3, further comprising:
determining a bitrate from the IVAS bitstream;
reading an index offset from a spatial reconstruction (SPAR) tool header (TH) section of the IVAS bitstream;
determining a table row index for the SPAR bitrate distribution control table using the index offset;
reading quantization strategy bits and coding strategy bits from a metadata payload (MDP) section in the IVAS bitstream;
unquantizing SPAR spatial metadata in the MDP section of the IVAS bitstream based on the quantization strategy bits and the coding strategy bits;
determining an Enhanced Voice Services (EVS) bitrate for each channel in the IVAS bitstream using a total available EVS bits, a SPAR bitrate distribution control table and a bitrate distribution algorithm;
reading EVS coded bits from the EP section of the IVAS bitstream based on the EVS bitrate;
decoding the EVS bits;
decoding the spatial metadata; and
generating first order Ambisonics (FoA) output using the decoded EVS bits and the decoded spatial metadata.

### Claim 17 (depends on 3)

A system comprising:
one or more processors; and
a non-transitory computer-readable medium storing instructions that, upon execution by the one or more processors, cause the one or more processors to perform operations of claim 3.

### Claim 18 (depends on 3)

A non-transitory, computer-readable medium storing instructions that, upon execution by one or more processors, cause the one or more processors to perform operations of claim 3.
