# US 2021/0176464 A1 · Joint chroma residual video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176464 A1
- Document ID: US20210176464A1
- Status: Published application
- Kind: A1
- Application number: 17/115,544
- Filed: 2020-12-08
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Bappaditya Ray; Geert Van der Auwera; Adarsh Krishnan Ramasubramonian; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20210176464A1

## CPC

- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/61: in combination with predictive coding
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video decoder can be configured to receive, for a first chroma component of a block of the video data, information for first residual samples that correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component; determine intermediate reconstructed samples based on the first residual samples; receive, for a second chroma component of the block of video data, information for second residual samples that correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples; reconstruct the first chroma block based on the first residual samples and the first prediction block; reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples; and output decoded video data comprising the reconstructed first chroma block and the reconstructed second chroma block.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
receiving information for first residual samples for a first chroma component of a block of the video data, wherein the first residual samples correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component;
determining intermediate reconstructed samples based on the first residual samples;
receiving information for second residual samples for a second chroma component of the block of video data, wherein the second residual samples correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples;
reconstructing the first chroma block based on the first residual samples and the first prediction block;
reconstructing the second chroma block based on the second residual samples and the intermediate reconstructed samples; and
outputting decoded video data comprising the reconstructed first chroma block and the reconstructed second chroma block.

### Claim 2 (depends on 1)

The method of claim 1, wherein the block of the video data is coded in a lossless coding mode.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining a second prediction block of the second chroma component using at least one of intra prediction or inter prediction; and
determining the intermediate reconstructed samples based on the first residual samples and the second prediction block of the second chroma component.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first chroma block and the second chroma block are of a same coding unit (CU).

### Claim 5 (depends on 1)

The method of claim 1, wherein reconstructing the second chroma block based on the second residual samples and the intermediate reconstructed samples comprises adding values of the second residual samples to corresponding values of the intermediate reconstructed samples.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining that the block of the video data is encoded in a joint coding of chroma residuals mode.

### Claim 7 (depends on 1)

The method of claim 1, wherein
reconstructing the first chroma block based on the first residual samples and the first prediction block comprises adding the first reconstructed chroma block to the first prediction block of the first chroma component to generate the first chroma block;
reconstructing the second chroma block based on the second residual samples and the intermediate reconstructed samples comprises adding values of the second residual samples to corresponding values of the intermediate reconstructed samples and to a second prediction block of the second chroma component to generate the second chroma block.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the intermediate reconstructed samples comprises determining the intermediate reconstructed samples according to one of the following equations:
rec1Cr[x][y]=Clip(predCr[x][y]+CSign*resJointC[x][y]>>1) or
Clip(predCr[x][y]+C Sign*k1*resJointC[x][y]), wherein
rec1Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCr[x][y] represents samples of a second prediction block of the second chroma component,
Csign is a sign value,
resJointC[x][y] represents samples of the first residual samples,
>> is a right-shift or divide by 2 operation, and
k1 is a pre-stored or signaled parameter.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining the intermediate reconstructed samples comprises determining the intermediate reconstructed samples according to the equation:
rec1Cr[x][y]=Clip(predCr[x][y]+CSign*resJointC[x][y]), wherein
rec1 Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCr[x][y] represents samples of a second prediction block of the second chroma component,
Csign is a sign value, and
resJointC[x][y] represents samples of the first residual samples.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining the intermediate reconstructed samples comprises determining the intermediate reconstructed samples according to one of the following equations:
rec1Cb[x][y]=Clip(predCb[x][y]+CSign*resJointC[x][y]>>1), or
Clip(predCb[x][y]+CSign*k2*resJointC[x][y]), wherein
rec1Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCb[x][y] represents samples of a second prediction block of the second chroma component,
CSign is a signal value,
resJointC[x][y] represents samples of the first residual samples,
>> is a right-shift or divide by two operation, and
k2 is a pre-stored or signaled parameter.

### Claim 11

A method of encoding video data, the method comprising:
determining first residual samples for a first chroma component of a block of the video data, wherein the first residual samples correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component;
determining intermediate reconstructed samples based on the first residual samples and a second prediction block of the second chroma component;
determining second residual samples for the second chroma component of the block of video data, wherein the second residual samples correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples; and
outputting, in a bitstream of encoded video data, syntax elements representing the first residual samples and the second residual samples.

### Claim 12 (depends on 11)

The method of claim 11, wherein the block of the video data is coded in a lossless coding mode.

### Claim 13 (depends on 11)

The method of claim 11, wherein the first chroma block and the second chroma block are of a same coding unit (CU).

### Claim 14 (depends on 11)

The method of claim 11, wherein
determining the intermediate reconstructed samples based on the first residual samples and the second prediction block of the second chroma component comprises adding values of the first residual samples to values of samples of the second prediction block.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
determining that the block of the video data is encoded in a joint coding of chroma residuals mode.

### Claim 16

A device for decoding video data, the device comprising:
a memory configured to store the video data;
one or more processors implemented in circuitry and configured to:
receive information for first residual samples for a first chroma component of a block of the video data, wherein the first residual samples correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component;
determine intermediate reconstructed samples based on the first residual samples;
receive information for second residual samples for a second chroma component of the block of video data, wherein the second residual samples correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples;
reconstruct the first chroma block based on the first residual samples and the first prediction block;
reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples; and
output decoded video data comprising the reconstructed first chroma block and the reconstructed second chroma block.

### Claim 17 (depends on 16)

The device of claim 16, wherein the block of the video data is coded in a lossless coding mode.

### Claim 18 (depends on 16)

The device of claim 16, wherein the one or more processors are further configured to
determine a second prediction block of the second chroma component using at least one of intra prediction or inter prediction; and
determine the intermediate reconstructed samples based on the first residual samples and the second prediction block of the second chroma component.

### Claim 19 (depends on 16)

The device of claim 16, wherein the first chroma block and the second chroma block are of a same coding unit (CU).

### Claim 20 (depends on 16)

The device of claim 16, wherein to reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples, the one or more processors are further configured to add values of the second residual samples to corresponding values of the intermediate reconstructed samples.

### Claim 21 (depends on 16)

The device of claim 16, wherein the one or more processors are further configured to:
determine that the block of the video data is encoded in a joint coding of chroma residuals mode.

### Claim 22 (depends on 16)

The device of claim 16, wherein
to reconstruct the first chroma block based on the first residual samples and the first prediction block, the one or more processors are further configured to adding the first reconstructed chroma block to the first prediction block of the first chroma component to generate the first chroma block;
to reconstruct the second chroma block based on the second residual samples and the intermediate reconstructed samples, the one or more processors are further configured to add values of the second residual samples to corresponding values of the intermediate reconstructed samples and to a second prediction block of the second chroma component to generate the second chroma block.

### Claim 23 (depends on 16)

The device of claim 16, wherein to determine the intermediate reconstructed samples, the one or more processors are further configured to determine the intermediate reconstructed samples according to one of the following equations:
rec1 Cr[x][y]=Clip(predCr[x][y]+CSign*resJointC[x][y]>>1) or
Clip(predCr[x][y]+C Sign*k1*resJointC[x][y]), wherein
rec1 Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCr[x][y] represents samples of a second prediction block of the second chroma component,
Csign is a sign value,
resJointC[x][y] represents samples of the first residual samples,
>> is a right-shift or divide by 2 operation, and
k1 is a pre-stored or signaled parameter.

### Claim 24 (depends on 16)

The device of claim 16, wherein to determine the intermediate reconstructed samples, the one or more processors are further configured to determine the intermediate reconstructed samples according to one of the following equations:
rec1Cr[x][y]=Clip(predCr[x][y]+CSign*resJointC[x][y]), wherein
rec1Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCr[x][y] represents samples of a second prediction block of the second chroma component,
Csign is a sign value, and
resJointC[x][y] represents samples of the first residual samples.

### Claim 25 (depends on 16)

The device of claim 16, wherein to determine the intermediate reconstructed samples, the one or more processors are further configured to determine the intermediate reconstructed samples according to one of the following equations:
rec1Cb[x][y]=Clip(predCb[x][y]+CSign*resJointC[x][y]>>1), or
Clip(predCb[x][y]+CSign*k2*resJointC[x][y]), wherein
rec1Cr[x][y] represents the intermediate reconstructed samples,
Clip is a clipping operation,
predCb[x][y] represents samples of a second prediction block of the second chroma component,
CSign is a signal value,
resJointC[x][y] represents samples of the first residual samples,
>> is a right-shift or divide by two operation, and
k2 is a pre-stored or signaled parameter.

### Claim 26 (depends on 16)

The device of claim 16, further comprising:
a display configured to display decoded video data.

### Claim 27 (depends on 16)

The device of claim 16, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

### Claim 28

A device of encoding video data, the device comprising:
a memory configured to store video data;
one or more processors implemented in circuitry and configured to:
determine first residual samples for a first chroma component of a block of the video data, wherein the first residual samples correspond to a difference between a first chroma block of the first chroma component and a first prediction block of the first chroma component;
determine intermediate reconstructed samples based on the first residual samples and a second prediction block of the second chroma component;
determine second residual samples for the second chroma component of the block of video data, wherein the second residual samples correspond to a difference between a second chroma block of the second chroma component and the intermediate reconstructed samples; and
output, in a bitstream of encoded video data, syntax elements representing the first residual samples and the second residual samples.

### Claim 29 (depends on 28)

The device of claim 28, wherein the block of the video data is coded in a lossless coding mode.

### Claim 30 (depends on 28)

The device of claim 28, wherein
to determine the intermediate reconstructed samples based on the first residual samples and the second prediction block of the second chroma component, the one or more processors are further configured to add values of the first residual samples to values of samples of the second prediction block.
