# US 2025/0220170 A1 · Tap-constrained convolutional cross-component model prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0220170 A1
- Document ID: US20250220170A1
- Status: Published application
- Kind: A1
- Application number: 18/987,529
- Filed: 2024-12-19
- Published: 2025-07-03
- Earliest claimed: 2024-01-02
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Xiang Li; In Suk Chong; Debargha Mukherjee; Cheng Chen; Yaowu Xu; Jingning Han
- Web page: https://patentgrep.com/patent/US20250220170A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/61: in combination with predictive coding
- H04N 19/635: characterised by filter definition or implementation details
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Tap-constrained convolutional cross-component model (CCCM) prediction enables hardware coder implementations of CCCM prediction by limiting the number of taps used to predict chroma samples while maintaining accuracy in the prediction. During encoding, a current luma sample of a block is identified. A number of taps to use for predicting a chroma sample associated with the current luma sample is determined based on a size of the block and/or whether the block is downsampled. The chroma sample is predicted using a prediction model limited to the number of taps and then encoded to an encoded bitstream. During decoding, a current luma sample of a block and a number of taps for predicting a chroma sample associated with the current luma sample are decoded from an encoded bitstream. The chroma sample is predicted using a prediction model limited to the number of taps and then output within an output video stream.

## Claims

### Claim 1

A method for tap-constrained convolutional cross-component model prediction, the method comprising:
decoding a current luma sample of a block from an encoded bitstream;
decoding a number of taps to use for predicting a chroma sample associated with the current luma sample from the encoded bitstream, wherein the number of taps is based on one or more of a size of the block or whether the block is downsampled;
predicting the chroma sample using a prediction model limited to the number of taps; and
outputting the chroma sample within an output video stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein taps of the number of taps are convolutional cross-component model prediction filter coefficients.

### Claim 3 (depends on 1)

The method of claim 1, wherein, where the number of taps is based on the size of the block, the number of taps is based on a comparison of the size of the block against a threshold number of chroma samples for the block to include.

### Claim 4 (depends on 1)

The method of claim 1, wherein, where the number of taps is based on whether the block is downsampled, the number of taps is based on whether one or both of the current luma sample or one or more other luma samples of the block are downsampled.

### Claim 5 (depends on 1)

The method of claim 1, wherein the prediction model is one of:
a first prediction model using, as the number of taps, three taps including a collocated luma sample, a non-linear term, and a bias term,
a second prediction model using, as the number of taps, four taps including a collocated luma sample, a non-linear term of the collocated luma sample, and two spatially neighboring luma samples of the collocated luma sample,
a third prediction model using, as the number of taps, four taps including a collocated luma sample, two spatially neighboring luma samples of the collocated luma sample, and a non-linear term of another spatially neighboring luma sample of the collocated luma sample, or
a fourth prediction model using, as the number of taps, five taps including a collocated luma sample, a non-linear term of the collocated luma sample, and three spatially neighboring samples of the collocated luma samples.

### Claim 6 (depends on 5)

The method of claim 5, wherein the prediction model is signaled within the associated with encoded bitstream.

### Claim 7 (depends on 1)

The method of claim 1, wherein predicting the chroma sample using the prediction model limited to the number of taps comprises:
determining first values of taps of the number of taps based on predicted and reconstructed chroma samples in a reference area associated with a spatial neighborhood of the current luma sample;
determining second values of samples of the prediction model; and
weighting the second values using the first values.

### Claim 8 (depends on 7)

The method of claim 7, wherein a size of the reference area is based on the number of taps.

### Claim 9

A non-transitory computer readable medium having stored thereon an encoded bitstream, wherein the encoded bitstream is configured for decoding by operations comprising:
decoding, from the encoded bitstream, a current luma sample of a block and a number of taps to use for predicting a chroma sample associated with the current luma sample;
predicting the chroma sample using a prediction model limited to the number of taps; and
outputting the chroma sample within an output video stream.

### Claim 10 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the number of taps is based on one or more of a size of the block or whether the block is downsampled.

### Claim 11 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein, where the number of taps is based on the size of the block and the size of the block meets a threshold number of chroma samples, the number of taps is a first number, and where the number of taps is based on the size of the block and the size of the block does not meet the threshold number of chroma samples, the number of taps is a second number less than the first number.

### Claim 12 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein, where the number of taps is based on whether the block is downsampled and the block is downsampled, the number of taps is a first number, and where the number of taps is based on whether the block is downsampled and the block is not downsampled, the number of taps is a second number greater than the first number.

### Claim 13 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein taps of the number of taps are convolutional cross-component model prediction filter coefficients.

### Claim 14 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the prediction model is signaled within the encoded bitstream.

### Claim 15

An apparatus for tap-constrained convolutional cross-component model prediction, the apparatus comprising:
a memory; and
a processor configured to execute instructions stored in the memory to:
predict, using a prediction model limited to a number of taps, a chroma sample associated with a current luma sample of a block, wherein the number of taps is based on one or more of a size of the block or whether the block is downsampled; and
output the chroma sample within an output video stream.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein, where the number of taps is based on the size of the block, the number of taps is based on a comparison of the size of the block against a threshold number of chroma samples for the block to include, and where the number of taps is based on whether the block is downsampled, the number of taps is based on whether one or both of the current luma sample or one or more other luma samples of the block are downsampled.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the number of taps is a first number of taps where the size of the block meets the threshold number of chroma samples or a second number of taps where the size of the block does not meet the threshold number of chroma samples, and wherein the first number of taps is greater than the second number of taps.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the number of taps is a first number of taps where the block is downsampled or a second number of taps where the block is not downsampled, and wherein the first number of taps is greater than the second number of taps.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein the processor is configured to execute the instructions to:
decode the number of taps and the current luma sample from an encoded bitstream.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein taps of the number of taps are convolutional cross-component model prediction filter coefficients.
