# US 2021/0176473 A1 · Inter-plane reuse of coding parameters

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176473 A1
- Document ID: US20210176473A1
- Status: Published application
- Kind: A1
- Application number: 17/113,604
- Filed: 2020-12-07
- Published: 2021-06-10
- Earliest claimed: 2010-04-13
- Assignees: Ge Video Compression, LLC
- Applicants: GE Video Compression, LLC
- Inventors: Martin WINKEN; Heiner KIRCHHOFFER; Heiko SCHWARZ; Detlev Marpe; Thomas WIEGAND
- Web page: https://patentgrep.com/patent/US20210176473A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.

## Claims

### Claim 1

A decoder for decoding a data stream encoded with a video represented by multiple arrays of information samples, comprising:
an extractor configured for:
extracting, from the data stream, a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,
extracting, from the data stream, inter-plane interchange information associated with a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether, for each second block of a plurality of second blocks of the second array, a second set of coding parameters used for reconstructing the respective second coding block is to be derived based on the first set of coding parameters, and
responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is not to be derived based on the first set of coding parameters, extracting, from the data stream, the second set of coding parameters;
a predictor configured for, responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is to be derived based on the first set of coding parameters, copying at least one of the first set of coding parameters as equal to at least one of the second set of coding parameters, wherein a sampling format of the first array is different than a sampling format of the second array; and
a reconstructor configured for reconstructing the second coding block based on the second set of coding parameters.

### Claim 2 (depends on 1)

The decoder of claim 1, wherein the extractor is further configured for predicting the second coding block based on the second set of coding parameters to generate a predicted second coding block, wherein the reconstructor configured for reconstructing the second coding block based on the predicted second coding block.

### Claim 3 (depends on 2)

The decoder of claim 2, wherein the extractor is further configured for extracting, from the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

### Claim 4 (depends on 3)

The decoder of claim 3, wherein the reconstructor is configured for reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

### Claim 5 (depends on 1)

The decoder of claim 1, wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

### Claim 6 (depends on 1)

The decoder of claim 1, wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

### Claim 7 (depends on 1)

The decoder of claim 1, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array.

### Claim 8 (depends on 1)

The decoder of claim 1, wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

### Claim 9

An encoder for encoding, into a data stream, a video represented by multiple arrays of information samples, comprising:
a data stream inserter configured for
inserting, into the data stream, a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,
inserting, into the data stream, inter-plane interchange information associated with a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether, for each second block of a plurality of second blocks of the second array, a second set of coding parameters used for reconstructing the respective second coding block is to be derived based on the first set of coding parameters, and
responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is not to be derived based on the first set of coding parameters, inserting, into the data stream, the second set of coding parameters; and
a predictor configured for responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is to be derived based on the first set of coding parameters, copying at least one of the first set of coding parameters as equal to at least one of the second set of coding parameters, wherein a sampling format of the first array is different than a sampling format of the second array,
wherein the second coding block is reconstructed based on the second set of coding parameters.

### Claim 10 (depends on 9)

The encoder of claim 9, wherein the predictor is further configured for predicting the second coding block based on the second set of coding parameters to generate a predicted second coding block.

### Claim 11 (depends on 10)

The encoder of claim 10, the data stream inserter is further configured for inserting, into the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

### Claim 12 (depends on 11)

The encoder of claim 11, wherein the second coding block is reconstructed based on the predicted second coding block and the residual information associated with the second coding block.

### Claim 13 (depends on 9)

The encoder of claim 9, wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

### Claim 14 (depends on 9)

The encoder of claim 9, wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter-prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

### Claim 15 (depends on 9)

The encoder of claim 9, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array.

### Claim 16 (depends on 9)

The encoder of claim 9, wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

### Claim 17

A non-transitory computer-readable medium storing a data stream, which is related to a video represented by multiple arrays of information samples, the data stream comprising:
a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,
inter-plane interchange information associated with a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether, for each second block of a plurality of second blocks of the second array, a second set of coding parameters used for reconstructing the respective second coding block is to be derived based on the first set of coding parameters, and
the second set of coding parameters associated with the second coding block when the inter-plane interchanging information signals that the second set of coding parameters is not to be derived based on the first set of coding parameters,
wherein if the inter-plane interchange information signals that the second set of coding parameters is to be derived based on the first set of coding parameters, at least one of the first set of coding parameters is copied equal to at least one of the second set of coding parameters, wherein a sampling format of the first array is different than a sampling format of the second array.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, further comprising the residual information associated with the second coding block inserted in accordance with the second set of coding parameters.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter-prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

### Claim 21 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array.

### Claim 22 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

### Claim 23

A method of decoding a data stream encoded with a video represented by multiple arrays of information samples, the method comprising:
extracting, from the data stream, a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block;
extracting, from the data stream, inter-plane interchange information associated with a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether, for each second block of a plurality of second blocks of the second array, a second set of coding parameters used for reconstructing the respective second coding block is to be derived based on the first set of coding parameters;
responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is not to be derived based on the first set of coding parameters, extracting, from the data stream, the second set of coding parameters;
responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is to be derived based on the first set of coding parameters, copying at least one of the first set of coding parameters as equal to at least one of the second set of coding parameters, wherein a sampling format of the first array is different than a sampling format of the second array; and
reconstructing the second coding block based on the second set of coding parameters.

### Claim 24 (depends on 23)

The method of claim 23, further comprising predicting the second coding block based on the second set of coding parameters to generate a predicted second coding block, wherein the reconstructor configured for reconstructing the second coding block based on the predicted second coding block.

### Claim 25 (depends on 24)

The method of claim 24, further comprising extracting, from the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

### Claim 26 (depends on 25)

The method of claim 25, wherein the reconstructing includes reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

### Claim 27 (depends on 23)

The method of claim 23, wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

### Claim 28 (depends on 23)

The method of claim 23, wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

### Claim 29 (depends on 23)

The method of claim 23, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array.

### Claim 30 (depends on 23)

The method of claim 23, wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.
