# US 2024/0406389 A1 · Method, apparatus, and medium for video processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0406389 A1
- Document ID: US20240406389A1
- Status: Published application
- Kind: A1
- Application number: 18/787,879
- Filed: 2024-07-29
- Published: 2024-12-05
- Earliest claimed: 2022-01-29
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Junru LI; Kai ZHANG; Li ZHANG; Yue LI
- Web page: https://patentgrep.com/patent/US20240406389A1

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination based on a model to the video unit; and performing the conversion based on the applying.

## Claims

### Claim 1

A method of video processing, comprising:
applying, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination based on a model to the video unit; and
performing the conversion based on the applying.

### Claim 2 (depends on 1)

The method of claim 1, wherein the applying is adaptive.

### Claim 3 (depends on 1)

The method of claim 1, wherein the applying is dependent on statistics of the video unit.

### Claim 4 (depends on 1)

The method of claim 1, wherein the model is a linear model or a neural network (NN) model.

### Claim 5 (depends on 1)

The method of claim 1, wherein samples output by the plurality of filters are put into a decoded picture buffer, or a final display signal.

### Claim 6 (depends on 1)

The method of claim 1, wherein the plurality of filters comprise a NN filter and/or a non-NN filter.

### Claim 7 (depends on 1)

The method of claim 1, wherein samples of the video unit are clipped by applying the plurality of filters.

### Claim 8 (depends on 1)

The method of claim 1, wherein the model is a linear model.

### Claim 9 (depends on 8)

The method of claim 8, wherein the linear model is represented by:
y
=
∑
a
k
*
x
k
+
b
,
wherein y represents a fusion sample which is output from the plurality of the filters, xk represents a filtered sample of a filter fk in the plurality of the filters, k represents an index of the filter fk and k is from 1 to K, K represents the total number of the plurality of the filters, and ak, and b are parameters of the linear model.

### Claim 10 (depends on 9)

The method of claim 9, wherein K=2 and b=0 and Σak=1, such that y=a1*x1+(1−a1)*x2.

### Claim 11 (depends on 1)

The method of claim 1, wherein whether to and/or how to construct one or more candidate lists of the plurality of filters are dependent on coding statistics of the video unit.

### Claim 12 (depends on 1)

The method of claim 1, wherein whether to and/or a way to utilize a fusion result of the plurality of filters is dependent on at least one of:
a coding mode of the video unit,
a coding statistic of the video unit,
a prediction mode,
QP,
a temporal layer,
a slice type,
a quantization step,
a block size of the video unit,
color components, or
a signal in the bitstream.

### Claim 13 (depends on 1)

The method of claim 1, wherein a model of a first filter in the plurality of filters is a simplified version of a model of a second filter in the plurality of filters.

### Claim 14 (depends on 1)

The method of claim 1, wherein the conversion is performed based on at least one syntax element indicating enabling of combined applying of a plurality of filters.

### Claim 15 (depends on 14)

The method of claim 14, wherein the at least one syntax element is indicated at a first level.

### Claim 16 (depends on 14)

The method of claim 14, wherein the at least one syntax element is indicated at a second level different from a first level.

### Claim 17 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the video unit into the bitstream, or
wherein the conversion includes decoding the video unit from the bitstream.

### Claim 18

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
apply, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination based on a model to the video unit; and
perform the conversion based on the applying.

### Claim 19

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
apply, during a conversion between a video unit of a video and a bitstream of the video unit, a plurality of filters in combination based on a model to the video unit; and
perform the conversion based on the applying.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video unit of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
applying a plurality of filters in combination based on a model to the video unit; and
generating the bitstream of the video unit based on the applying.
