# US 2025/0220157 A1 · Method, apparatus, and medium for video processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0220157 A1
- Document ID: US20250220157A1
- Status: Published application
- Kind: A1
- Application number: 19/080,649
- Filed: 2025-03-14
- Published: 2025-07-03
- Earliest claimed: 2022-09-15
- Assignees: Douyin Vision Co., Ltd.; Bytedance Inc.
- Applicants: Douyin Vision Co, Ltd.; Bytedance Inc.
- Inventors: Wei JIA; Kai ZHANG; Yang WANG; Tianliang FU; Yue LI; Li ZHANG
- Web page: https://patentgrep.com/patent/US20250220157A1

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/182: the unit being a pixel
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/593: involving spatial prediction techniques
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: selecting, for a conversion between a current video block of a video and a bitstream of the video, a set of samples in a first color component of the current video block based on information regarding applying a geometric transformation on the current video block; determining a prediction of at least one sample in a second color component of the current video block based on the set of samples and a gradient linear model (GLM), the second color component being different from the first color component; and performing the conversion based on the prediction.

## Claims

### Claim 1

A method for video processing, comprising:
selecting, for a conversion between a current video block of a video and a bitstream of the video, a set of samples in a first color component of the current video block based on information regarding applying a geometric transformation on the current video block;
determining a prediction of at least one sample in a second color component of the current video block based on the set of samples and a gradient linear model (GLM), the second color component being different from the first color component; and
performing the conversion based on the prediction.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the prediction of the at least one sample comprises:
determining a gradient based on the set of samples in the first color component; and
determining the prediction based on a linear model of the gradient.

### Claim 3 (depends on 1)

The method of claim 1, wherein the information comprises at least one of the following: whether to apply the geometric transformation on the current video block, or how to apply the geometric transformation on the current video block, or
wherein the geometric transformation comprises at least one of the following: adjusting an orientation of the current video block, or adjusting positions of samples in the current video block, or
wherein if the geometric transformation is applied on the current video block, the set of samples in the first color component are selected by using a first filter, and if the geometric transformation is not applied on the current video block, the set of samples in the first color component are selected by using a second filter, or
wherein the geometric transformation is applied on the current video block to obtain a first video block, and a corresponding relationship between samples in the first color component and the second color component for coding the first video block is adjusted for the GLM, or
wherein the geometric transformation is applied on the current video block to obtain the first video block, and information regarding at least one of the following is dependent on a color format of the current video block: whether to adjust the corresponding relationship between samples in the first color component and the second color component for coding the first video block, or how to adjust the corresponding relationship.

### Claim 4 (depends on 1)

The method of claim 1, wherein the information regarding applying the geometric transformation on the current video block is dependent on coding information of the current video block or coding information of a neighboring video block of the current video block, or
wherein if the current video block is on an I-slice, the geometric transformation is applied on the current video block.

### Claim 5 (depends on 1)

The method of claim 1, wherein the information regarding applying the geometric transformation on the current video block is indicated by at least one syntax element in the bitstream.

### Claim 6 (depends on 1)

The method of claim 1, wherein the geometric transformation is applied on the current video block to obtain a first video block, and if a dimension of the first video block is different from a dimension of the current video block, dimension information regarding at least one of the following is indicated in the bitstream:
a width of the current video block,
a height of the current video block,
a width of the first video block, or
a height of the first video block.

### Claim 7 (depends on 6)

The method of claim 6, wherein the dimension information is indicated in one of the following:
a sequence parameter set (SPS),
a picture parameter set (PPS),
a picture header,
a slice header,
a coding tree unit (CTU), or
a coding unit (CU).

### Claim 8 (depends on 1)

The method of claim 1, wherein the geometric transformation is applied on the current video block, and the method further comprising:
obtaining a first video block, the first video block being generated by applying the geometric transformation on the current video block; and
generating a second video block based on a further transformation on the first video block, the further transformation being an inverse process of the geometric transformation.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first video block is generated and encoded into the bitstream at an encoder, or
wherein obtaining the first video block comprises: obtaining the first video block from the bitstream, or
wherein positions of the samples in the current video block are adjusted by flipping the current video block.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
determining information regarding applying a further geometric transformation on a further video block of the video based on a rate-distortion optimization (RDO) process, the further video block being different from the current video block.

### Claim 11 (depends on 10)

The method of claim 10, wherein luma and chroma rate-distortion (RD) costs are determined for a plurality of candidate geometric transformation schemes, and the further geometric transformation comprises a candidate geometric transformation scheme with a least luma and chroma RD cost.

### Claim 12 (depends on 10)

The method of claim 10, wherein the further geometric transformation is applied on the further video block, and at least one coding tool is used with a condition during the determination of the further geometric transformation based on the RDO process.

### Claim 13 (depends on 12)

The method of claim 12, wherein the at least one coding tool comprises at least one of the following:
an intra prediction scheme, or
an inter prediction scheme.

### Claim 14 (depends on 13)

The method of claim 13, wherein at least one of the following is not used:
a matrix weighted intra prediction (MIP),
a multiple reference line (MRL) intra prediction,
an intra sub-partitions (ISP),
a decoder side intra mode derivation (DIMD),
a template-based intra mode derivation (TIMD),
a cross-component linear model (CCLM),
a multi-model linear model (MMLM),
the GLM,
a convolutional cross-component model (CCCM), or
a chroma decoder-side intra mode derivation (DIMD).

### Claim 15 (depends on 1)

The method of claim 1, wherein the method is applicable in a coding tool requiring one of the following:
a frame relocation,
a CCLM adjustment,
a GLM adjustment, or
a CCCM adjustment.

### Claim 16 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the current video block into the bitstream.

### Claim 17 (depends on 1)

The method of claim 1, wherein the conversion includes decoding the current video block from the bitstream.

### Claim 18

An apparatus for video processing comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform acts comprising:
selecting, for a conversion between a current video block of a video and a bitstream of the video, a set of samples in a first color component of the current video block based on information regarding applying a geometric transformation on the current video block;
determining a prediction of at least one sample in a second color component of the current video block based on the set of samples and a gradient linear model (GLM), the second color component being different from the first color component; and
performing the conversion based on the prediction.

### Claim 19

A non-transitory computer-readable storage medium storing instructions that cause a processor to perform acts comprising:
selecting, for a conversion between a current video block of a video and a bitstream of the video, a set of samples in a first color component of the current video block based on information regarding applying a geometric transformation on the current video block;
determining a prediction of at least one sample in a second color component of the current video block based on the set of samples and a gradient linear model (GLM), the second color component being different from the first color component; and
performing the conversion based on the prediction.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by an apparatus for video processing, wherein the method comprises:
selecting a set of samples in a first color component of a current video block of the video based on information regarding applying a geometric transformation on the current video block;
determining a prediction of at least one sample in a second color component of the current video block based on the set of samples and a gradient linear model (GLM), the second color component being different from the first color component; and
generating the bitstream based on the prediction.
