# US 2024/0187576 A1 · Method, apparatus, and medium for video processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0187576 A1
- Document ID: US20240187576A1
- Status: Published application
- Kind: A1
- Application number: 18/438,028
- Filed: 2024-02-09
- Published: 2024-06-06
- Earliest claimed: 2021-08-13
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Yang WANG; Kai ZHANG; Li ZHANG
- Web page: https://patentgrep.com/patent/US20240187576A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the present disclosure provide a method for video processing. The method comprises: determining, during a conversion between a current chroma block of a video and a bitstream of the video, a set of target modes of cross component intra prediction (CCIP) for the current chroma block based on reconstructed samples or predicted samples of neighboring samples of the current chroma block; and performing the conversion based on the set of target modes. Compared with the conventional solution, the proposed method can advantageously improve coding efficiency.

## Claims

### Claim 1

A method for video processing, comprising:
determining, during a conversion between a current chroma block of a video and a bitstream of the video, a set of target modes of cross component intra prediction (CCIP) for the current chroma block based on reconstructed samples or predicted samples of neighboring samples of the current chroma block; and
performing the conversion based on the set of target modes.

### Claim 2 (depends on 1)

The method of claim 1, wherein the set of target modes are determined further based on residual information of the neighboring samples, or
wherein the neighboring samples are in the same color component of the current chroma block, or
wherein the neighboring samples are in different color components of the current chroma block, or
wherein determining the set of target modes comprises: determining the set of target modes based on a template comprising the reconstructed samples of the neighboring samples, or
wherein the CCIP comprises at least one of: cross-component linear model (CCLM), or multi-model linear model (MMLM), or
wherein a template used to determine the set of target modes comprises at least one of:
reconstructed samples adjacent to the current chroma block,
reconstructed samples non-adjacent to the current chroma block,
neighboring left-above reconstructed samples of the current chroma block,
neighboring left reconstructed samples of the current chroma block,
neighboring above reconstructed samples of the current chroma block,
neighboring left-below reconstructed samples of the current chroma block, or
neighboring right-above reconstructed samples of the current chroma block.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining the set of target modes based on the template comprises:
constructing a CCIP mode candidate list for the current chroma block; and
determining the set of target modes from the CCIP mode candidate list based on the template.

### Claim 4 (depends on 3)

The method of claim 3, wherein the CCIP mode candidate list comprises at least one of:
a LM mode of cross-component linear model (CCLM),
a LM_T mode of CCLM,
a LM_L mode of CCLM,
a MMLM mode of multi-model linear model (MMLM),
a MMLM_T mode of MMLM, or
a MMLM_L mode of MMLM, or
wherein determining the set of target modes from the CCIP mode candidate list based on the template comprises:
determining costs for part of or all of modes in the CCIP mode candidate list based on the template; and
determining the set of target modes from the CCIP mode candidate list based on the costs.

### Claim 5 (depends on 4)

The method of claim 4, wherein determining the set of target modes from the CCIP mode candidate list based on the costs comprises: determining a mode with the minimum cost in the CCIP mode candidate list to be a first target mode in the set of target modes, or
wherein determining the costs comprises:
determining a set of parameters for a model of a first mode in the CCIP mode candidate list based on training samples of the template;
determining predicted samples of the template based on the set of parameters and corresponding samples of the template, the corresponding samples being in a color component different from the template; and
determining a first cost for the first mode based on the predicted samples of the template and reconstructed samples of the template.

### Claim 6 (depends on 2)

The method of claim 2, wherein a first set of training samples for determining parameters for a model of a first mode of CCIP for the template are the same as a second set of training samples for determining parameters for the model for the current chroma block.

### Claim 7 (depends on 6)

The method of claim 6, wherein a shape of the template is the same as a shape of the current chroma block, or
a size of the template is the same as a size of the current chroma block, or
the number of training samples in the first set is the same as the number of training samples in the second set.

### Claim 8 (depends on 1)

The method of claim 1, wherein the set of target modes comprise a first subset of target modes for a first chroma component of the current chroma block and a second subset of target modes for a second chroma component of the current chroma block, the first subset and the second subset being determined individually, or
wherein performing the conversion comprises:
determining predicted samples or reconstructed samples of at least one color component of the current chroma block based on the set of target modes of CCIP; and
performing the conversion based on the predicted samples or the reconstructed samples of the at least one color component, or
wherein performing the conversion comprises:
determining predicted samples or reconstructed samples of at least one color component of the current chroma block based on the set of target modes of CCIP; and
performing the conversion based on the predicted samples or the reconstructed samples of the at least one color component,
wherein the set of target modes comprise a plurality of target modes and the target mode used for the conversion is indicated in the bitstream, or the target mode used for the conversion is determined on-the-fly, or the target mode used for the conversion is dependent on coding information of the current chroma block or a set of neighboring blocks of the current chroma block.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first subset of target modes are determined in the same manner as the second subset of target modes.

### Claim 10 (depends on 1)

The method of claim 1, wherein performing the conversion comprises:
determining a plurality of predicted signals for the current chroma block based on a plurality of IPMs;
determining a final prediction of the current chroma block based on the plurality of predicted signals; and
performing the conversion based on the final prediction.

### Claim 11 (depends on 10)

The method of claim 10, wherein the plurality of IPMs comprise at least one of:
the set of target modes,
a further mode of CCIP, or
a target IPM.

### Claim 12 (depends on 1)

The method of claim 1, wherein whether a target chroma block of the video is coded with a decoder-side derivation of CCIP (DCCIP) is determined on-the-fly, or
wherein whether a target chroma block of the video is coded with DCCIP is determined based on at least one of:
whether CCIP is allowed,
block dimensions,
a block size,
a block depth,
a slice type,
a picture type,
a partition tree type,
a block location, or
a color component, or
wherein information on DCCIP is indicated as a set of syntax elements in the bitstream.

### Claim 13 (depends on 12)

The method of claim 12, wherein information on DCCIP for chroma components of the current chroma block is indicated in the bitstream by one syntax element of the set of syntax elements, or
information on DCCIP for chroma components is indicated in the bitstream by a plurality of syntax elements of the set of syntax elements.

### Claim 14 (depends on 1)

The method of claim 1, wherein whether a target chroma block of the video is allowed to be coded with DCCIP is dependent on a set of syntax elements.

### Claim 15 (depends on 14)

The method of claim 14, wherein the set of syntax elements are indicated in the bitstream as general constraints information, or
wherein the set of syntax elements are included in one of:
a sequence header,
a picture header,
a sequence parameter set (SPS),
a video parameter set (VPS),
a dependency parameter set (DPS),
a decoding capability information (DCI),
a picture parameter set (PPS),
an adaptation parameter sets (APS),
a slice header, or
a tile group header.

### Claim 16 (depends on 15)

The method of claim 15, wherein the target chroma block is not allowed to be coded with DCCIP, if a syntax element of the set of syntax elements indicates general constrain on DCCIP is equal to a predetermined value.

### Claim 17 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the current chroma block into the bitstream, or
wherein the conversion includes decoding the current chroma block from the bitstream.

### Claim 18

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, during a conversion between a current chroma block of a video and a bitstream of the video, a set of target modes of cross component intra prediction (CCIP) for the current chroma block based on reconstructed samples or predicted samples of neighboring samples of the current chroma block; and
perform the conversion based on the set of target modes.

### Claim 19

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, during a conversion between a current chroma block of a video and a bitstream of the video, a set of target modes of cross component intra prediction (CCIP) for the current chroma block based on reconstructed samples or predicted samples of neighboring samples of the current chroma block; and
perform the conversion based on the set of target modes.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining a set of target modes of cross component intra prediction (CCIP) for a current chroma block of the video based on reconstructed samples or predicted samples of neighboring samples of the current chroma block; and
generating the bitstream based on the set of target modes.
