# US 12,114,000 B2 · Combined residual coding in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,114,000 B2
- Document ID: US12114000B2
- Status: Granted
- Kind: B2
- Application number: 16/810,680
- Filed: 2020-03-05
- Published: 2020-09-10
- Granted: 2024-10-08
- Earliest claimed: 2019-03-08
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Geert Van der Auwera; Bappaditya Ray; Adarsh Krishnan Ramasubramonian; Muhammed Zeyd Coban; Luong Pham Van; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US12114000B2

## CPC

- H04N 19/45: {performing compensation of the inverse transform mismatch, e.g. Inverse Discrete Cosine Transform [IDCT] mismatch}
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video decoder may apply a first inverse residual modification function to first decoded modified chroma residual data to generate first inverse modified chroma residual data. Additionally, the video decoder may apply a second inverse residual modification function to second decoded modified chroma residual data to generate second inverse modified chroma residual data. The first decoded modified chroma residual data is associated with a first chroma component and the second decoded modified chroma residual data is associated with a second chroma component. The video decoder may reconstruct a block of video data based on the first inverse modified chroma residual data and the second inverse modified chroma residual data.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
generating decoded modified chroma residual data by applying an inverse transform to convert a set of transform coefficients of a block of the video data from a transform domain to a sample domain;
after generating the decoded modified chroma residual data, applying a first inverse residual modification function to the decoded modified chroma residual data to generate first inverse modified chroma residual data for a first chroma component, wherein the first inverse residual modification function sets the first inverse modified chroma residual data equal to the decoded modified chroma residual data;
after generating the decoded modified chroma residual data, applying a second inverse residual modification function to the decoded modified chroma residual data to generate second inverse modified chroma residual data for a second chroma component, wherein the second inverse residual modification function sets the second inverse modified chroma residual data equal to a value divided by 2, where the value is equal to 0 minus the decoded modified chroma residual data; and
reconstructing the block of the video data based on the first inverse modified chroma residual data and the second inverse modified chroma residual data.

### Claim 2 (depends on 1)

The method of claim 1, wherein reconstructing the block comprises:
adding the first inverse modified chroma residual data to first predicted chroma data to obtain first reconstructed chroma data of the block; and
adding the second inverse modified chroma residual data to second predicted chroma data to obtain second reconstructed chroma data of the block.

### Claim 3 (depends on 1)

The method of claim 1, wherein the method further comprises:
determining whether to apply the first inverse residual modification function or a third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
determining whether to apply the second inverse residual modification function or a fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
determining whether to apply the first inverse residual modification function or the third inverse residual modification function comprises determining, based on one or more characteristics of the block, whether to apply the first inverse residual modification function or the third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
determining whether to apply the second inverse residual modification function or the fourth inverse residual modification function comprises determining, based on the one or more characteristics of the block, whether to apply the second inverse residual modification function or the fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 5 (depends on 4)

The method of claim 4, wherein the characteristics of the block include one or more of: whether a slice or tile that contains the block is an intra type or an inter type, whether current picture referencing is used with the block, whether a dual or shared coding tree is used with the block, dimensions of the block, or an aspect ratio of the block.

### Claim 6 (depends on 3)

The method of claim 3, wherein:
determining whether to apply the first inverse residual modification function or the third inverse residual modification function comprises determining, based on data signaled in a bitstream, whether to apply the first inverse residual modification function or the third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
determining whether to apply the second inverse residual modification function or the fourth inverse residual modification function comprises determining, based on the data signaled in the bitstream, whether to apply the second inverse residual modification function or the fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 7

A device for decoding video data, the device comprising:
a memory to store the video data; and
one or more processors implemented in circuitry, the one or more processors configured to:
generate decoded modified chroma residual data by applying an inverse transform to convert a set of transform coefficients of a block of the video data from a transform domain to a sample domain;
after generating the decoded modified chroma residual data, apply a first inverse residual modification function to the decoded modified chroma residual data to generate first inverse modified chroma residual data for a first chroma component, wherein the first inverse residual modification function sets the first inverse modified chroma residual data equal to the decoded modified chroma residual data;
after generating the decoded modified chroma residual data, apply a second inverse residual modification function to the decoded modified chroma residual data to generate second inverse modified chroma residual data for a second chroma component, wherein the second inverse residual modification function sets the second inverse modified chroma residual data equal to a value divided by 2, where the value is equal to 0 minus the decoded modified chroma residual data; and
reconstruct the block of the video data based on the first inverse modified chroma residual data and the second inverse modified chroma residual data.

### Claim 8 (depends on 7)

The device of claim 7, wherein the one or more processors are configured such that, as part of reconstructing the block, the one or more processors:
add the first inverse modified chroma residual data to first predicted chroma data to obtain first reconstructed chroma data of the block; and
add the second inverse modified chroma residual data to second predicted chroma data to obtain second reconstructed chroma data of the block.

### Claim 9 (depends on 7)

The device of claim 7, wherein the one or more processors are further configured to:
determine whether to apply the first inverse residual modification function or a third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
determine whether to apply the second inverse residual modification function or a fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 10 (depends on 9)

The device of claim 9, wherein:
the one or more processors are configured such that, as part of determining whether to apply the first inverse residual modification function or the third inverse residual modification function, the one or more processors determine, based on one or more characteristics of the block, whether to apply the first inverse residual modification function or the third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
the one or more processors are configured such that, as part of determining whether to apply the second inverse residual modification function or the fourth inverse residual modification function, the one or more processors determine, based on the one or more characteristics of the block, whether to apply the second inverse residual modification function or the fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 11 (depends on 10)

The device of claim 10, wherein the characteristics of the block include one or more of: whether a slice or tile that contains the block is an intra type or an inter type, whether current picture referencing is used with the block, whether a dual or shared coding tree is used with the block, dimensions of the block, or an aspect ratio of the block.

### Claim 12 (depends on 9)

The device of claim 9, wherein:
the one or more processors are configured such that, as part of determining whether to apply the first inverse residual modification function or the third inverse residual modification function, the one or more processors determine, based on data signaled in a bitstream, whether to apply the first inverse residual modification function or the third inverse residual modification function to the decoded modified chroma residual data to generate the first inverse modified chroma residual data; and
the one or more processors are configured such that, as part of determining whether to apply the second inverse residual modification function or the fourth inverse residual modification function, the one or more processors determine, based on the data signaled in the bitstream, whether to apply the second inverse residual modification function or the fourth inverse residual modification function to the decoded modified chroma residual data to generate the second inverse modified chroma residual data.

### Claim 13 (depends on 7)

The device of claim 7, further comprising a display configured to display decoded video data.

### Claim 14 (depends on 7)

The device of claim 7, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

### Claim 15

A device for decoding video data, the device comprising:
means for generating decoded modified chroma residual data by applying an inverse transform to convert a set of transform coefficients of a block of the video data from a transform domain to a sample domain;
means for applying, after generating the decoded modified chroma residual data, a first inverse residual modification function to the decoded modified chroma residual data to generate first inverse modified chroma residual data for a first chroma component, wherein the first inverse residual modification function sets the first inverse modified chroma residual data equal to the decoded modified chroma residual data;
means for applying, after generating the decoded modified chroma residual data, a second inverse residual modification function to the decoded modified chroma residual data to generate second inverse modified chroma residual data for a second chroma component, wherein the second inverse residual modification function sets the second inverse modified chroma residual data equal to a value divided by 2, where the value is equal to 0 minus the decoded modified chroma residual data; and
means for reconstructing the block of the video data based on the first inverse modified chroma residual data and the second inverse modified chroma residual data.

### Claim 16

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:
generate decoded modified chroma residual data by applying an inverse transform to convert a set of transform coefficients of a block of video data from a transform domain to a sample domain;
after generating the decoded modified chroma residual data, apply a first inverse residual modification function to the decoded modified chroma residual data to generate first inverse modified chroma residual data for a first chroma component, wherein the first inverse residual modification function sets the first inverse modified chroma residual data equal to the decoded modified chroma residual data;
after generating the decoded modified chroma residual data, apply a second inverse residual modification function to the decoded modified chroma residual data to generate second inverse modified chroma residual data for a second chroma component, wherein the second inverse residual modification function sets the second inverse modified chroma residual data equal to a value divided by 2, where the value is equal to 0 minus the decoded modified chroma residual data; and
reconstruct the block of the video data based on the first inverse modified chroma residual data and the second inverse modified chroma residual data.