# US 2020/0404307 A1 · Bit-plane coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404307 A1
- Document ID: US20200404307A1
- Status: Published application
- Kind: A1
- Application number: 16/988,629
- Filed: 2020-08-08
- Published: 2020-12-24
- Earliest claimed: 2017-07-10
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Joachim KEINERT; Thomas RICHTER; Miguel Ángel MARTÍNEZ DEL AMOR; Manuel DE FRUTOS LÓPEZ; Christian SCHERL; Herbert THOMA; Siegfried FOESSEL
- Web page: https://patentgrep.com/patent/US20200404307A1

## CPC

- H04N 19/45: {performing compensation of the inverse transform mismatch, e.g. Inverse Discrete Cosine Transform [IDCT] mismatch}
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/1883: {the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]}
- H04N 19/61: in combination with predictive coding
- H04N 19/625: using discrete cosine transform [DCT]
- H04N 19/645: by grouping of coefficients into blocks after the transform
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A coding efficiency improvement is achieved by performing bit-plane coding in a manner so that coefficient groups for which the set of coded bit-planes is predictively signaled in the datastream, are grouped in two group sets and if a signal is spent in the datastream which signals, for a group set, whether the set of coded bit-planes of all coefficient groups of the respective group set are empty, i.e. all coefficients within the respective group sets are insignificant. In accordance with another aspect, a coding efficiency improvement is achieved by providing bit-plane coding with group-set-wise insignificant signalization according to the first aspect as a coding option alternative relative to the signalization for group sets for which it is signaled that there is no coded prediction residual for the coded bit-planes for the claim groups within the respective group set.

## Claims

### Claim 1

A decoder configured to decode transform coefficients from a data stream, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the decoder being configured to
derive from the data stream information which identifies a first subset of group sets for which a significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
for each group set out of the first subset, for each coefficient group of the respective group set,
identify a first set of coded bit planes by
deriving a first prediction for the first set of coded bit planes based on a first previously decoded coefficient group,
correcting the first prediction using a first prediction residual derived from the data stream so as to acquire a corrected prediction for the first set of coded bit planes.
derive bits of the respective coefficient group within the corrected prediction for first set of coded bit planes from the data stream at a code rate of 1;
for each group set of the second subset, inherit that for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant.

### Claim 2 (depends on 1)

The decoder according to claim 1, configured to derive from the data stream whether the significance coding mode is applied or not;
if the significance coding mode is not applied, skip the derivation of the information from the data stream and infer that the second subset is empty.

### Claim 3 (depends on 2)

The decoder according to claim 2, wherein the transform coefficients form one sub-portion of a plurality of sub-portions of a spectral decomposition of a picture, and the decoder is configured to derive from the data stream wether the significance coding mode is applied or not on a per sub-portion basis.

### Claim 4 (depends on 3)

The decoder according to claim 3, wherein the sub-portions are sub-bands or groups of transform coefficients relating to a corresponding spatial region of spatial regions into which the picture is sub-divided.

### Claim 5 (depends on 1)

The decoder according to claim 1, configured to derive from the data stream truncation information indicating a set of one or more truncated least significant bit planes for each coefficient group, and the first prediction and the corrected prediction indicate a most significant bit plane index relative to a most significant truncated bit plane of the set of one or more truncated least significant bit planes.

### Claim 6 (depends on 5)

The decoder according to claim 5, configured to derive from the data stream the truncation information indicating the set of one or more truncated least significant bit planes at a granularity of coefficient group rows, sub-bands, or groups of transform coefficients relating to a corresponding spatial region of spatial regions into which the picture is sub-divided.

### Claim 7 (depends on 1)

The decoder according to claim 1, wherein the transform coefficients are spectral coefficients of a spectrally decomposition of a picture.

### Claim 8 (depends on 1)

The decoder according to claim 1, wherein the transform coefficients are DCT or wavelet coefficients.

### Claim 9 (depends on 1)

The decoder according to claim 1, wherein the transform coefficients are spectral coefficients of a spectral decomposition of a picture into sub-bands, and grouped into the coefficient groups in a manner so that transform coefficients within one coefficient group belong to the same sub-band.

### Claim 10 (depends on 1)

The decoder according to claim 1, configured to derive the information from the data stream as one flag per group set, with group sets for which the flag assumes a first state, belonging to the first subset of group sets, and group sets for which the flag assumes a second state, belonging to the first subset of group sets.

### Claim 11 (depends on 1)

The decoder according to claim 1, configured to perform the deriving of the first prediction residual using a unary VLC code.

### Claim 12 (depends on 1)

The decoder according to claim 1, configured to set insignificant coefficients to zero or pseudo noise.

### Claim 13

An encoder configured to encode transform coefficients into a data stream, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the encoder being configured to
insert into the data stream information which identifies a first subset of group sets for which the significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
for each group set out of the first subset, for each coefficient group of the respective group set,
identify a first set of coded bit planes by
deriving a first prediction for the first set of coded bit planes based on a first previously coded coefficient group,
insert into the data stream a first prediction residual for correcting the first prediction so as to acquire a corrected prediction for the first set of coded bit planes,
insert bits of the respective coefficient group within the corrected prediction for the first set of coded bit planes into the data stream at a code rate of 1,
wherein, for each group set of the second subset, for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant.

### Claim 14

A method for decoding transform coefficients from a data stream, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the method comprising
deriving from the data stream information which identifies a first subset of group sets for which a significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
for each group set out of the first subset, for each coefficient group of the respective group set,
identifying a first set of coded bit planes by
deriving a first prediction for the first set of coded bit planes based on a first previously decoded coefficient group,
correcting the first prediction using a first prediction residual derived from the data stream so as to acquire a corrected prediction for the first set of coded bit planes,
deriving bits of the respective coefficient group within the corrected prediction for first set of coded bit planes from the data stream at a code rate of 1;
for each group set of the second subset, inheriting that for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant.

### Claim 15

A method for encoding transform coefficients into a data stream, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the method comprising
inserting into the data stream information which identifies a first subset of group sets for which the significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
for each group set out of the first subset, for each coefficient group of the respective group set,
identifying a first set of coded bit planes by
deriving a first prediction for the first set of coded bit planes based on a first previously coded coefficient group,
insert into the data stream a first prediction residual for correcting the first prediction so as to acquire a corrected prediction for the first set of coded bit planes,
inserting bits of the respective coefficient group within the corrected prediction for the first set of coded bit planes into the data stream at a code rate of 1,
wherein, for each group set of the second subset, for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant.

### Claim 16

A digital storage medium storing a picture by means of a data stream which has transform coefficients of a spectral decomposition of the picture encoded thereinto, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the data stream comprising
information which identifies a first subset of group sets for which the significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
wherein, for each group set out of the first subset, for each coefficient group of the respective group set,
a first set of coded bit planes is identified by the data stream
relative to a first prediction for the first set of coded bit planes derived based on a first previously coded coefficient group,
by way of a first prediction residual which corrects the first prediction so as to acquire a corrected prediction for the first set of coded bit planes,
wherein the data stream comprises bits of the respective coefficient group within the corrected prediction for the first set of coded bit planes into the data stream at a code rate of 1,
wherein, for each group set of the second subset, for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant.

### Claim 17

A non-transitory digital storage medium having a computer program stored thereon to perform the method for decoding transform coefficients from a data stream, the transform coefficients being grouped into coefficient groups, the coefficient groups being grouped into group sets, the method comprising
deriving from the data stream information which identifies a first subset of group sets for which a significance coding mode is not to be used, and a second subset of group sets for which the significance coding mode is to be used;
for each group set out of the first subset, for each coefficient group of the respective group set,
identifying a first set of coded bit planes by
deriving a first prediction for the first set of coded bit planes based on a first previously decoded coefficient group,
correcting the first prediction using a first prediction residual derived from the data stream so as to acquire a corrected prediction for the first set of coded bit planes,
deriving bits of the respective coefficient group within the corrected prediction for first set of coded bit planes from the data stream at a code rate of 1;
for each group set of the second subset, inheriting that for each coefficient group of respective group set, coefficients of the respective coefficient group are insignificant,
when said computer program is run by a computer.