# US 2022/0191526 A1 · Chroma samples from luma samples prediction for video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0191526 A1
- Document ID: US20220191526A1
- Status: Published application
- Kind: A1
- Application number: 17/119,810
- Filed: 2020-12-11
- Published: 2022-06-16
- Earliest claimed: 2020-12-11
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Dhruv Aggarwal; Anand Singh; Akarsh Ningoji Rao Kolekar
- Web page: https://patentgrep.com/patent/US20220191526A1

## CPC

- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/426: using memory downsizing methods
- H04N 19/42: characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence)
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video coder may be configured code a chroma block of video data as a function of reconstructed luma samples. The video coder may store, during the prediction process for a luma block, a sum of the reconstructed luma sample values for each sub-block of the luma block in a first buffer, and store, during the prediction process for the luma block, an average of the reconstructed luma sample values in a second buffer. The video coder may perform chroma from luma prediction to reconstruct a chroma block of the video data corresponding to the luma block using the sums and the average.

## Claims

### Claim 1

An apparatus configured to code video data, the apparatus comprising:
one or more memory units configured to store video data; and
one or more processors implemented in circuitry and in communication with the one or more memory units, the one or more processors configured to:
perform a prediction process for a luma block of the video data to form reconstructed luma sample values;
determine, during the prediction process for the luma block to form the reconstructed luma sample values, a sum of the reconstructed luma sample values for each sub-block of a plurality of sub-blocks of the luma block, wherein the sum of the reconstructed luma sample values is determined based on a summation of each of the reconstructed luma sample values within the respective sub-block with one another;
store, during the prediction process for the luma block to form the reconstructed luma sample values, the sum of the reconstructed luma sample values for each sub-block of the luma block in a first buffer of the one or more memory units;
store, during the prediction process for the luma block to form the reconstructed luma sample values, an average of the reconstructed luma sample values in a second buffer of the one or more memory units; and
perform chroma from luma prediction to reconstruct a chroma block of the video data corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the one or more processors are further configured to:
calculate, during the prediction process for the luma block to form the reconstructed luma sample values, the average of the reconstructed luma sample values.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the one or more processors are further configured to:
perform chroma from luma prediction for chroma samples of the chroma block corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values, without reading the reconstructed luma samples values from the one or more memory units.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the sub-block is a 2×2 sub-block, and wherein the one or more processors are further configured to:
perform a DC intra prediction process to determine a respective DC prediction values for each respective chroma sample of the chroma block;
calculate a respective scaled luma sample value for each respective chroma sample as a function of a scaling factor for the chroma block, a respective sum of the reconstructed luma sample values of a respective 2×2 sub-block corresponding to the respective chroma sample, and the average of the reconstructed luma sample values;
calculate a respective intermediate prediction sample value for each respective chroma sample as a function of the respective DC prediction value and the respective scaled luma sample value;
calculate a respective final prediction sample value for each respective chroma sample as a function of the respective intermediate prediction sample value and a maximum sample value; and
reconstruct respective chroma sample values using the respective final prediction sample values.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the one or more processors are further configured to:
perform the DC intra prediction process to determine the respective DC prediction values for each respective chroma sample of the chroma block in parallel with performing the prediction process for the luma block.

### Claim 6 (depends on 4)

The apparatus of claim 4, wherein the one or more processors are further configured to:
decode a block of residual values for the chroma block; and
add each respective residual value to a corresponding respective final prediction sample value to reconstruct the chroma sample values of the chroma block.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein to perform the chroma from luma prediction, the one or more processors are further configured to:
access the sums of the reconstructed luma sample values for each sub-block of the luma block from the first buffer using odd-even banking.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising:
a display configured to display a picture including pixels values determined from the reconstructed chroma block.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the apparatus is a mobile device.

### Claim 10 (depends on 9)

The apparatus of claim 9, further comprising:
a receiver configured to receive the video data via a wireless communication standard.

### Claim 11

A method of decoding video data, the method comprising:
performing a prediction process for a luma block of the video data to form reconstructed luma sample values;
determining, during the prediction process for the luma block to form the reconstructed luma sample values, a sum of the reconstructed luma sample values for each sub-block of a plurality of sub-blocks of the luma block, wherein the sum of the reconstructed luma sample values is determined based on a summation of each of the reconstructed luma sample values within the respective sub-block with one another;
storing, during the prediction process for the luma block to form the reconstructed luma sample values, the sum of the reconstructed luma sample values for each sub-block of the luma block in a first buffer;
storing, during the prediction process for the luma block to form the reconstructed luma sample values, an average of the reconstructed luma sample values in a second buffer; and
performing chroma from luma prediction to reconstruct a chroma block of the video data corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
calculating, during the prediction process for the luma block to form the reconstructed luma sample values, the average of the reconstructed luma sample values.

### Claim 13 (depends on 11)

The method of claim 11, wherein performing chroma from luma prediction to reconstruct the chroma block of the video data comprises:
performing chroma from luma prediction for chroma samples of the chroma block corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values, without reading the reconstructed luma samples values from the one or more memory units.

### Claim 14 (depends on 11)

The method of claim 11, wherein the sub-block is a 2×2 sub-block, and wherein performing chroma from luma prediction to reconstruct the chroma block of the video data comprises:
performing a DC intra prediction process to determine a respective DC prediction values for each respective chroma sample of the chroma block;
calculating a respective scaled luma sample value for each respective chroma sample as a function of a scaling factor for the chroma block, a respective sum of the reconstructed luma sample values of a respective 2×2 sub-block corresponding to the respective chroma sample, and the average of the reconstructed luma sample values;
calculating a respective intermediate prediction sample value for each respective chroma sample as a function of the respective DC prediction value and the respective scaled luma sample value;
calculating a respective final prediction sample value for each respective chroma sample as a function of the respective intermediate prediction sample value and a maximum sample value; and
reconstructing respective chroma sample values using the respective final prediction sample values.

### Claim 15 (depends on 14)

The method of claim 14, wherein performing the DC intra prediction process comprises:
performing the DC intra prediction process to determine the respective DC prediction values for each respective chroma sample of the chroma block in parallel with performing the prediction process for the luma block.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
decoding a block of residual values for the chroma block; and
adding each respective residual value to a corresponding respective final prediction sample value to reconstruct the chroma sample values of the chroma block.

### Claim 17 (depends on 11)

The method of claim 11, wherein performing the chroma from luma prediction, comprises:
accessing the sums of the reconstructed luma sample values for each sub-block of the luma block from the first buffer using odd-even banking.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
displaying a picture including pixels values determined from the reconstructed chroma block.

### Claim 19

A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to decode video data to:
perform a prediction process for a luma block of the video data to form reconstructed luma sample values;
determine, during the prediction process for the luma block to form the reconstructed luma sample values, a sum of the reconstructed luma sample values for each sub-block of a plurality of sub-blocks of the luma block, wherein the sum of the reconstructed luma sample values is determined based on a summation of each of the reconstructed luma sample values within the respective sub-block with one another;
store, during the prediction process for the luma block to form the reconstructed luma sample values, the sum of the reconstructed luma sample values for each sub-block of the luma block in a first buffer;
store, during the prediction process for the luma block to form the reconstructed luma sample values, an average of the reconstructed luma sample values in a second buffer; and
perform chroma from luma prediction to reconstruct a chroma block of the video data corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the instructions further cause the one or more processors to:
calculate, during the prediction process for the luma block to form the reconstructed luma sample values, the average of the reconstructed luma sample values.

### Claim 21 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the instructions further cause the one or more processors to:
perform chroma from luma prediction for chroma samples of the chroma block corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values, without reading the reconstructed luma samples values from the one or more memory units.

### Claim 22 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the sub-block is a 2×2 sub-block, and wherein the instructions further cause the one or more processors to:
perform a DC intra prediction process to determine a respective DC prediction values for each respective chroma sample of the chroma block;
calculate a respective scaled luma sample value for each respective chroma sample as a function of a scaling factor for the chroma block, a respective sum of the reconstructed luma sample values of a respective 2×2 sub-block corresponding to the respective chroma sample, and the average of the reconstructed luma sample values;
calculate a respective intermediate prediction sample value for each respective chroma sample as a function of the respective DC prediction value and the respective scaled luma sample value;
calculate a respective final prediction sample value for each respective chroma sample as a function of the respective intermediate prediction sample value and a maximum sample value; and
reconstruct respective chroma sample values using the respective final prediction sample values

### Claim 23 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the instructions further cause the one or more processors to:
perform the DC intra prediction process to determine the respective DC prediction values for each respective chroma sample of the chroma block in parallel with performing the prediction process for the luma block.

### Claim 24 (depends on 22)

The non-transitory computer-readable storage medium of claim 22, wherein the instructions further cause the one or more processors to:
decode a block of residual values for the chroma block; and
add each respective residual value to a corresponding respective final prediction sample value to reconstruct the chroma sample values of the chroma block.

### Claim 25 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein to perform the chroma from luma prediction, the instructions further cause the one or more processors to:
access the sums of the reconstructed luma sample values for each sub-block of the luma block from the first buffer using odd-even banking.

### Claim 26 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the instructions further cause the one or more processors to:
display a picture including pixels values determined from the reconstructed chroma block.

### Claim 27

An apparatus configured to decode video data, the apparatus comprising:
means for performing a prediction process for a luma block of the video data to form reconstructed luma sample values;
means for determining, during the prediction process for the luma block to form the reconstructed luma sample values, a sum of the reconstructed luma sample values for each sub-block of a plurality of sub-blocks of the luma block, wherein the sum of the reconstructed luma sample values is determined based on a summation of each of the reconstructed luma sample values within the respective sub-block with one another;
means for storing, during the prediction process for the luma block to form the reconstructed luma sample values, the sum of the reconstructed luma sample values for each sub-block of the luma block in a first buffer;
means for storing, during the prediction process for the luma block to form the reconstructed luma sample values, an average of the reconstructed luma sample values in a second buffer; and
means for performing chroma from luma prediction to reconstruct a chroma block of the video data corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values.

### Claim 28 (depends on 27)

The apparatus of claim 27, further comprising:
means for calculating, during the prediction process for the luma block to form the reconstructed luma sample values, the average of the reconstructed luma sample values.

### Claim 29 (depends on 27)

The apparatus of claim 27, wherein the means for performing chroma from luma prediction comprises:
means for performing chroma from luma prediction for chroma samples of the chroma block corresponding to the luma block using the sums of the reconstructed luma sample values for each sub-block of the luma block and the average of the reconstructed luma sample values, without reading the reconstructed luma samples values from the one or more memory units.

### Claim 30 (depends on 27)

The apparatus of claim 27, wherein the sub-block is a 2×2 sub-block, and wherein the means for performing chroma from luma prediction comprises:
means for performing a DC intra prediction process to determine a respective DC prediction values for each respective chroma sample of the chroma block;
means for calculating a respective scaled luma sample value for each respective chroma sample as a function of a scaling factor for the chroma block, a respective sum of the reconstructed luma sample values of a respective 2×2 sub-block corresponding to the respective chroma sample, and the average of the reconstructed luma sample values;
means for calculating a respective intermediate prediction sample value for each respective chroma sample as a function of the respective DC prediction value and the respective scaled luma sample value;
means for calculating a respective final prediction sample value for each respective chroma sample as a function of the respective intermediate prediction sample value and a maximum sample value; and
means for reconstructing respective chroma sample values using the respective final prediction sample values.

### Claim 31 (depends on 30)

The apparatus of claim 30, wherein the means for performing the DC intra prediction process comprises:
means for performing the DC intra prediction process to determine the respective DC prediction values for each respective chroma sample of the chroma block in parallel with performing the prediction process for the luma block.

### Claim 32 (depends on 30)

The apparatus of claim 30, further comprising:
means for decoding a block of residual values for the chroma block; and
means for adding each respective residual value to a corresponding respective final prediction sample value to reconstruct the chroma sample values of the chroma block.

### Claim 33 (depends on 27)

The apparatus of claim 27, wherein the means for performing the chroma from luma prediction, comprises:
means for accessing the sums of the reconstructed luma sample values for each sub-block of the luma block from the first buffer using odd-even banking.

### Claim 34 (depends on 27)

The apparatus of claim 27, further comprising:
means for displaying a picture including pixels values determined from the reconstructed chroma block.
