# US 2020/0286494 A1 · Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0286494 A1
- Document ID: US20200286494A1
- Status: Published application
- Kind: A1
- Application number: 16/870,396
- Filed: 2020-05-08
- Published: 2020-09-10
- Earliest claimed: 2017-11-10
- Assignees: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Inventors: Emmanuel Ravelli; Guillaume Fuschs; Markus Schnell; Adrian Tomasek; Stefan Geyersberger
- Web page: https://patentgrep.com/patent/US20200286494A1

## CPC

- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 19/032: Quantisation or dequantisation of spectral components
- G10L 19/002: Dynamic bit allocation (for perceptual audio coders G10L19/032)
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- H03M 7/3059: {Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression}
- H03M 7/3066: {by means of a mask or a bit-map}
- H03M 7/6005: {Decoder aspects}
- H03M 7/6011: {Encoder aspects}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)

## Abstract

An audio decoder for providing a decoded audio information on the basis of an encoded audio information is configured to obtain decoded spectral values on the basis of an encoded information representing the spectral values. The audio decoder is configured to jointly decode two or more most significant bits per spectral value on the basis of respective symbol codes for a set of spectral values using an arithmetic decoding, wherein a respective symbol code represents two or more most significant bits per spectral value for one or more spectral values. The audio decoder is configured to decode one or more least significant bits associated with one or more of the spectral values in dependence on how much least significant bit information is available, such that one or more least significant bits associated with one or more of the spectral values are decoded.

## Claims

### Claim 1

An audio decoder for providing a decoded audio information on the basis of an encoded audio information,
wherein the audio decoder is configured to acquire decoded spectral values on the basis of an encoded information representing the spectral values,
wherein the audio decoder is configured to decode one or more most significant bits on the basis of respective symbol codes for a plurality of spectral values, and to decode one or more least significant bits for one or more of the spectral values,
wherein the audio decoder is configured to be switchable between
a first mode in which a decoding of spectral values in a higher frequency range is omitted in response to a signaling from the encoder and in which least significant bits are decoded for all spectral values for which one or more most significant bits are decoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are decoded, while no least significant bits are decoded for one or more other spectral values for which one or more most significant bits have been decoded and which comprise more bits than the most significant bits; and
wherein the audio decoder is configured to provide the decoded audio information using the spectral values.

### Claim 2 (depends on 1)

The audio decoder according to claim 1, wherein the arithmetic decoding is configured to determine bit positions of the one or more most significant bits and to allocate the one or more most significant bits determined by a symbol of the arithmetically encoded representation to the determined bit positions

### Claim 3 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to decode, for all spectral values for which one or more most significant bits have been decoded and which comprise more bits than the one or more most significant bits and a least significant bit, one or more intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits.

### Claim 4 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to decode, when operating in the second mode, in a first decoding phase,
one or more most significant bits per spectral value, and
for all spectral values for which one or more most significant bits are decoded and which comprise more bits than the one or more most significant bits and a least significant bit, one or more intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and
for all spectral values for which one or more most significant bits are decoded and for which the one or more most significant bits and any intermediate bits, as far as intermediate bits are present, indicate a non-zero value, signs; and
wherein the audio decoder is configured to selectively omit, when operating in the second mode, in the first decoding phase, a decoding of a sign for spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and
wherein the audio decoder is configured to selectively acquire, when operating in the second mode, in a second decoding phase which follows the first decoding phase, sign information for spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value and for which a least significant bit information indicates a non-zero value.

### Claim 5 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to sequentially use subsequent bits of a least-significant-bit-information bit sequence in order to acquire least significant bit values associated with the spectral values when operating in the second mode.

### Claim 6 (depends on 5)

The audio decoder according to claim 5, wherein the audio decoder is configured to use, when operating in the second mode, a single bit of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a non-zero value, wherein the used single bit of the least-significant-bit-information bitsequence is used in order to acquire a least significant bit value; and
wherein the audio decoder is configured to use, when operating in the second mode, a single bit of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and for which the used single bit of the least-significant-bit-information bitsequence confirms the zero value; and
wherein the audio decoder is configured to use, when operating in the second mode, two subsequent bits of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and for which a first of the used bits of the least-significant-bit-information bitsequence indicates a deviation from the zero value by a least significant bit value, wherein a second of the used bits of the least-significant-bit-information bitsequence determines a sign of the respective spectral value.

### Claim 7 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to decode, when operating in the second mode, least significant bits starting from a least significant bit associated with a lowest frequency spectral value and proceeding towards spectral values associated with increasingly higher frequencies,
such that spectral values are refined by least-significant-bit information in a range from a lowest frequency spectral value up to a spectral value for which a last least significant bit information is available, and such that spectral values comprising associated frequencies higher than a frequency associated with the spectral value for which the last least significant bit information is available remain unrefined.

### Claim 8 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to evaluate a bitstream flag which is comprised in the encoded audio information in order to decide whether the audio decoder operates in the first mode or in the second mode.

### Claim 9 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to acquire intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and the least significant bit associated with a given spectral value from a contiguous bit sequence in the first mode, and
wherein the audio decoder is configured to acquire intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and the least significant bit associated with a given spectral value from separate bit sequences or from separate, non-contiguous bit locations of a bit sequence in the second mode.

### Claim 10 (depends on 1)

The audio decoder according to claim 1, wherein the audio decoder is configured to selectively acquire a sign information associated with a spectral value only after a decoding of the one or or most significant bits, any intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and the least significant bit associated with a given spectral value in the first mode, in dependence on whether the one or more most significant bits, the intermediate bits and the least significant bit indicate a zero value or not, and
wherein the audio decoder is configured to selectively acquire a sign information associated with a spectral value after a decoding of the one or ore most significant bits and any intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, but before a least significant bit associated with a given spectral value is decoded in the second mode, in dependence on whether the one or more most significant bits and the intermediate bits indicate a zero value or not.

### Claim 11

An audio encoder for providing an encoded audio information on the basis of an input audio information,
wherein the audio encoder is configured to acquire spectral values representing an audio content of the input audio information, and
wherein the audio encoder is configured to encode at least a plurality of the spectral values, in order to acquire an encoded information representing the spectral values;
wherein the audio encoder is configured to encode one or more most significant bits, to acquire respective symbol codes for a plurality of the spectral values, and to encode one or more least significant bits for one or more of the spectral values,
wherein a respective symbol code represents one or more most significant bits values for one or more spectral values,
wherein the audio encoder is configured to be switchable between
a first mode in which an encoding of non-zero spectral values in a higher frequency range is omitted in case that an available bit budget is used up by an encoding of spectral values in a lower frequency range and in which least significant bits are encoded for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are encoded, while no least significant bits are encoded for one or more other spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits;
wherein the audio encoder is configured to provide the encoded audio information using the encoded information representing the spectral values.

### Claim 12 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode at least one or more most significant bits of all non-zero spectral values or of all non-zero groups of spectral values in the second mode.

### Claim 13 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to limit, when operating in the first mode, a frequency range, for which spectral values are encoded, in case that a bit budget is insufficient, such that one or more spectral values are left unconsidered in the encoding of spectral values.

### Claim 14 (depends on 13)

The audio encoder according to claim 13, wherein the audio encoder is configured to determine, when operating in the first mode, a maximum frequency value and to encode, when operating in the first mode, spectral values up to the maximum frequency and to leave, when operating in the first mode, spectral values above the maximum frequency unencoded even if the spectral values are non-zero,
wherein the audio encoder is configured to select, when operating in the first mode, the maximum frequency value in dependence on a computation or estimation of a bit demand for encoding all spectral values, such that a number of spectral values to be encoded is reduced if the computed or estimated bit demand would exceed a bit budget, and wherein the audio encoder is configured to determine, when operating in the second mode, the maximum frequency value and to encode when operating in the second mode, spectral values up to the maximum frequency and to leave, when operating in the second mode, spectral values above the maximum frequency unencoded,
wherein the audio encoder is configured to select, when operating in the second mode, the maximum frequency value such that at least one or more most significant bits of all non-zero spectral values or of all non-zero groups of spectral values are encoded and such that at most zero-valued spectral values are left unencoded.

### Claim 15 (depends on 13)

The audio encoder according to claim 13, wherein the audio encoder is configured to incorporate an information describing the maximum frequency into the encoded audio information.

### Claim 16 (depends on 13)

The audio encoder according to claim 13, wherein the audio encoder is configured to make a mode decision whether to use the first mode or the second mode in dependence on an available bit rate.

### Claim 17 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to make a mode decision whether to use the first mode or the second mode in dependence on a number of spectral values or groups of spectral values which comprise, in addition to one or more most significant bits encoded in a most-significant-bit-encoding step, one or more least significant bits, an encoding of which can selectively be omitted in dependence on a bit demand and a bit budget.

### Claim 18 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to incorporate a bitstream flag in the encoded audio information indicating whether the audio encoder operates in the first mode or in the second mode.

### Claim 19 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and the least significant bit associated with a given spectral value into a contiguous bit sequence in the first mode, and
wherein the audio encoder is configured to encode intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and the least significant bit associated with a given spectral value into separate bit sequences or into separate, non-contiguous bit locations of a bit sequence in the second mode.

### Claim 20 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode, when operating in the first mode, a sign information associated with a spectral value in a bit sequence which is associated with intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and least significant bits, and
wherein the audio encoder is configured to selectively encode, when operating in the second mode, a sign information associated with a spectral value in a bit sequence which is associated with intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and sign information or in a bit sequence associated with least significant bits and sign information, such that sign information for spectral values which deviate from zero only by a least significant bit value are encoded in the bit sequence associated with least significant bits and sign information.

### Claim 21 (depends on 11)

The audio encoder according to claim 11, wherein the arithmetic encoding is configured to determine bit positions of the one or more most significant bits and incorporate into the arithmetically encoded representation an information describing the bit positions.

### Claim 22 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to map at least two most significant bits of the at least one spectral value onto one symbol of an arithmetically encoded representation, which represents the at least two most significant bits of the at least one spectral value.

### Claim 23 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode, for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the one or more most significant bits and a least significant bit, one or more intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits.

### Claim 24 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode, in a first encoding phase,
one or more most significant bits per spectral value, and
for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the one or more most significant bits and a least significant bit, one or more intermediate bits, bit positions of which are between the least significant bit and the one or more most significant bits, and
for all spectral values for which one or more most significant bits are encoded and for which the one or more most significant bits and any intermediate bits, as far as intermediate bits are present, indicate a non-zero value, signs; and
wherein the audio encoder is configured to selectively omit, in the first encoding phase, an encoding of a sign for spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and
wherein the audio encoder is configured to selectively encode, in a second encoding phase which follows the first encoding phase, sign information for spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value and for which a least significant bit information indicates a non-zero value.

### Claim 25 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to only incorporate a sign information into the encoded audio representation for spectral values which only differ from zero by a least significant bit if the least significant bit of such spectral values is actually encoded.

### Claim 26 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to sequentially provide subsequent bits of a least-significant-bit-information bit sequence in order to encode least significant bit values associated with the spectral values.

### Claim 27 (depends on 26)

The audio encoder according to claim 26, wherein the audio encoder is configured to provide a single bit of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a non-zero value, wherein the used single bit of the least-significant-bit-information bitsequence is used in order to encode a least significant bit value; and
wherein the audio encoder is configured to provide a single bit of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and for which the provided single bit of the least-significant-bit-information bitsequence confirms the zero value; and
wherein the audio encoder is configured to provide two subsequent bits of the least-significant-bit-information bitsequence for respective spectral values for which the one or more most significant values and any intermediate bits, as far as intermediate bits are present, indicate a zero value, and for which a first of the provided bits of the least-significant-bit-information bitsequence indicates a deviation from the zero value by a least significant bit value, wherein a second of the provided bits of the least-significant-bit-information bitsequence encodes a sign of the respective spectral value.

### Claim 28 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode least significant bits starting from a least significant bit associated with a lowest frequency spectral value and proceeding towards spectral values associated with increasingly higher frequencies,
such that encoded information for refining spectral values by least-significant-bit information is provided in a range from a lowest frequency spectral value up to a spectral value for which a last least significant bit information is provided, and
such that no encoded information for refining spectral values by least-significant-bit information is provided for spectral values comprising associated frequencies higher than a frequency associated with the spectral value for which the last least significant bit information is provided.

### Claim 29 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to be switchable between
a first mode in which an encoding of non-zero spectral values in a higher frequency range is omitted in case that an available bit budget is used up by encoded spectral values in a lower frequency range and in which least significant bits are encoded for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are encoded, while no least significant bits are encoded for one or more other spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bit.

### Claim 30 (depends on 29)

The audio encoder according to claim 29, wherein the audio encoder is configured to provide a bitstream flag which is comprised in the encoded audio information in order to indicate whether the audio encoder operates in the first mode or in the second mode.

### Claim 31 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to jointly encode one or more most significant bits per spectral value for at least two spectral values using respective symbol codes,
wherein a respective symbol code represents one or more most significant bits per spectral value for at least two spectral values.

### Claim 32 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to determine, when operating in the second mode, an actual highest-frequency non-zero spectral value and to encode at least one or more most significant bits of all non-zero spectral values or of all non-zero groups of spectral values.

### Claim 33 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to encode, when operating in the second mode, all bits except for a least significant bit for all non-zero spectral values, and
wherein the audio encoder is configured to encode least significant bits for spectral values until a bit budget is exhausted.

### Claim 34 (depends on 11)

The audio encoder according to claim 11, wherein the audio encoder is configured to acquire a gain information which determines quantization steps of a quantization of spectral values, and which determines a bit demand for encoding the quantized spectral values.

### Claim 35

A method for providing a decoded audio information on the basis of an encoded audio information,
wherein the method comprises acquiring decoded spectral values on the basis of an encoded information representing the spectral values,
wherein the method comprises decoding one or more most significant bits on the basis of respective symbol codes for a plurality of spectral values, and
decoding one or more least significant bits for one or more of the spectral values,
wherein the method comprises selecting between
a first mode in which a decoding of spectral values in a higher frequency range is omitted in response to a signaling from the encoder and in which least significant bits are decoded for all spectral values for which one or more most significant bits are decoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are decoded, while no least significant bits are decoded for one or more other spectral values for which one or more most significant bits have been decoded and which comprise more bits than the most significant bits; and
wherein the method comprises providing the decoded audio information using the spectral values.

### Claim 36

A method for providing an encoded audio information on the basis of an input audio information,
wherein the method comprises acquiring spectral values representing an audio content of the input audio information, and
wherein the method comprises encoding at least a plurality of the spectral values, in order to acquire an encoded information representing the spectral values;
wherein the method comprises encoding one or more most significant bits, to acquire respective symbol codes for a plurality of the spectral values, and encoding one or more least significant bits for one or more of the spectral values,
wherein a respective symbol code represents one or more most significant bits values for one or more spectral values,
wherein the method comprises selecting between
a first mode in which an encoding of non-zero spectral values in a higher frequency range is omitted in case that an available bit budget is used up by an encoding of spectral values in a lower frequency range and in which least significant bits are encoded for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are encoded, while no least significant bits are encoded for one or more other spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits;
wherein the method comprises providing the encoded audio information using the encoded information representing the spectral values.

### Claim 37

A non-transitory digital storage medium having a computer program stored thereon to perform the method for providing a decoded audio information on the basis of an encoded audio information,
wherein the method comprises acquiring decoded spectral values on the basis of an encoded information representing the spectral values,
wherein the method comprises decoding one or more most significant bits on the basis of respective symbol codes for a plurality of spectral values, and
decoding one or more least significant bits for one or more of the spectral values,
wherein the method comprises selecting between
a first mode in which a decoding of spectral values in a higher frequency range is omitted in response to a signaling from the encoder and in which least significant bits are decoded for all spectral values for which one or more most significant bits are decoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are decoded, while no least significant bits are decoded for one or more other spectral values for which one or more most significant bits have been decoded and which comprise more bits than the most significant bits; and
wherein the method comprises providing the decoded audio information using the spectral values,
when said computer program is run by a computer.

### Claim 38

A non-transitory digital storage medium having a computer program stored thereon to perform the method for providing an encoded audio information on the basis of an input audio information,
wherein the method comprises acquiring spectral values representing an audio content of the input audio information, and
wherein the method comprises encoding at least a plurality of the spectral values, in order to acquire an encoded information representing the spectral values;
wherein the method comprises encoding one or more most significant bits, to acquire respective symbol codes for a plurality of the spectral values, and encoding one or more least significant bits for one or more of the spectral values,
wherein a respective symbol code represents one or more most significant bits values for one or more spectral values,
wherein the method comprises selecting between
a first mode in which an encoding of non-zero spectral values in a higher frequency range is omitted in case that an available bit budget is used up by an encoding of spectral values in a lower frequency range and in which least significant bits are encoded for all spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits, and
a second mode in which one or more least significant bits associated with one or more of the spectral values are encoded, while no least significant bits are encoded for one or more other spectral values for which one or more most significant bits are encoded and which comprise more bits than the most significant bits;
wherein the method comprises providing the encoded audio information using the encoded information representing the spectral values,
when said computer program is run by a computer.

### Claim 39

An encoded audio representation, comprising:
an encoded information representing spectral values; and
a flag indicating whether an audio decoder should work
in a first mode in which a decoding of spectral values in a higher frequency range is omitted in response to a signaling from the encoder and in which least significant bits are decoded for all spectral values for which one or more most significant bits are decoded and which comprise more bits than the most significant bits, or
in a second mode in which one or more least significant bits associated with one or more of the spectral values are decoded, while no least significant bits are decoded for one or more other spectral values for which one or more most significant bits have been decoded and which comprise more bits than the most significant bits.
