# US 2024/0187567 A1 · Adaptive motion candidate list

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0187567 A1
- Document ID: US20240187567A1
- Status: Published application
- Kind: A1
- Application number: 18/286,212
- Filed: 2022-04-09
- Published: 2024-06-06
- Earliest claimed: 2021-04-09
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Na ZHANG; Kai ZHANG; Li ZHANG; Hongbin LIU; Zhipin DENG; Yang WANG
- Web page: https://patentgrep.com/patent/US20240187567A1

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/52: by predictive encoding
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a current block of a video and a bitstream, reference samples of a sub-template of the current block based on a first set of reference samples of the sub-template in a first reference list and a second set of reference samples of the sub-template in a second reference list; and determining a target motion candidate list based on the reference samples of the sub-template. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency.

## Claims

### Claim at position 1

-87. (canceled)

### Claim 88

A method for video processing, comprising:
determining, during a conversion between a current block of a video and a bitstream of the video, reference samples of a sub-template of the current block based on a first set of reference samples of the sub-template in a first reference list and a second set of reference samples of the sub-template in a second reference list; and
determining a target motion candidate list based on the reference samples of the sub-template.

### Claim 89 (depends on 88)

The method of claim 88, wherein determining the reference samples of the sub-template comprises:
determining a weighted average of the first set of reference samples and the second set of reference samples, wherein the first set of reference samples are associated with a first weight, and the second set of reference samples are associated with a second weight; and
determining the reference sample of the template based on the weighted average.

### Claim 90 (depends on 88)

The method of claim 88, wherein the reference samples of the sub-template (RI) are determined according to:
RT(x,y)=(RT0(x,y)+RT1(x,y)+1)>>1
wherein RT0 denotes the first set of reference samples and RT1 denotes the second set of reference samples.

### Claim 91 (depends on 89)

The method of claim 89, wherein the reference samples of the sub-template (RT) are determined according to:
RT(x,y)=((2N−w)*RT0(x,y)+w*RT1(x,y)+2N−1)>>N
wherein RT0 denotes the first set of reference samples, RT1 denotes the second set of reference samples, and Nis a positive integer.

### Claim 92 (depends on 91)

The method of claim 91, wherein w is determined according to at least one of the following rules:
if a CU-level weight (BCW) index is equal to 0, w is set equal to −2;
if the BCW index is equal to 1, w is set equal to 3;
if the BCW index is equal to 2, w is set equal to 4;
if the BCW index is equal to 3, w is set equal to 5; or
if the BCW index is equal to 4, w is set equal to 10.

### Claim 93 (depends on 89)

The method of claim 89, wherein:
at least one of the first weight and the second weight is determined based on a BCW index;
at least one of the first weight and the second weight is predefined;
at least one of the first weight and the second weight is comprised in the bitstream; or
at least one of the first weight and the second weight is determined based on a weight used in weighted prediction.

### Claim 94 (depends on 88)

The method of claim 88, wherein the reference samples of the sub-template are derived with a multi-hypothesis prediction method if a corresponding merge candidate uses multi-hypothesis prediction.

### Claim 95 (depends on 88)

The method of claim 88, wherein determining the target motion candidate list comprises:
constructing a first motion candidate list for the current block;
determining a reordering scheme; and
determining the target motion candidate list based on the reordering scheme and the reference samples.

### Claim 96 (depends on 95)

The method of claim 95, wherein determining the reordering scheme comprises:
determining a reordering scheme to indicate that the first motion candidate list or at least one motion candidate in the first motion candidate list is to be reordered, in accordance with a determination that the at least one motion candidate belongs to at least one of the following categories:
a category of adjacent spatial motion candidates,
a category of temporal motion candidates,
a category of spatial temporal motion vector prediction (STMVP) motion candidates,
a category of non-adjacent spatial motion candidates,
a category of history-based motion vector prediction (HMVP) motion candidates, or
a category of pair-wise average motion candidates.

### Claim 97 (depends on 95)

The method of claim 95, wherein determining a reordering scheme comprises:
determining a reordering scheme to indicate that at least one zero motion candidate is not to be reordered; or
determining a reordering scheme to indicate that at least one motion candidate in the first motion candidate list is not to be reordered in accordance with a determination that the at least one motion candidate belongs to at least one of the following categories:
a category of uni-prediction subblock based motion candidates,
a category of subblock-based temporal motion vector prediction (SbTMVP) motion candidates,
a category of inherited affine motion candidates,
a category of constructed affine motion candidates, or
a category of zero padding affine motion candidates; or
determining the reordering scheme to indicate that a number of motion candidates from a beginning of the first motion candidate list are to be reordered; or
determining the reordering scheme based on the at least one subgroup of motion candidates.

### Claim 98 (depends on 97)

The method of claim 97, wherein the reordering scheme indicates at least one of the following:
only the first subgroup of motion candidates is to be reordered,
a last subgroup of motion candidates is not to be reordered,
the last subgroup of motion candidates is to be reordered if the last subgroup is also the first group,
different subgroups are to be reordered separately,
two motion candidates in different subgroups are not to be reordered together, or
a first motion candidate in a first subgroup is to be put ahead of a second motion candidate in a second subgroup after reordering if the first subgroup is ahead of the second subgroup.

### Claim 99 (depends on 88)

The method of claim 88, wherein determining the first motion candidate list comprises:
in accordance with a determination that the reordering scheme indicates that at least one first motion candidate in the first motion candidate list is not to be reordered,
determining an order of the first at least one motion candidate within the target motion candidate list according to an original order of the at least one first motion candidate within the first motion candidate list; or
in accordance with a determination that the reordering scheme indicates that at least one first motion candidate in the first motion candidate list is not to be reordered and at least one second motion candidate in the first motion candidate list is to be reordered,
arranging, within the target motion candidate list, the at least one first motion candidate to be ahead of the at least one second motion candidate to be reordered, or
arranging, within the target motion candidate list, the at least one first motion candidate to follow the at least one second motion candidate to be reordered.

### Claim 100 (depends on 88)

The method of claim 88, wherein the sub-template comprises samples of at least one color component.

### Claim 101 (depends on 100)

The method of claim 100, wherein the sub-template only comprises samples of the luma component, the sub-template comprises samples of the at least one of: a Cb component, a Cr component, a R component, a G component or a B component.

### Claim 102 (depends on 88)

The method of claim 88, wherein the conversion comprises:
decoding the current block from the bitstream; or encoding the current block into the bitstream.

### Claim 103 (depends on 88)

The method of claim 88, further comprising:
determining, during a conversion between a first block of a video and a bitstream of the video, reference samples of a template or a sub-template of the first block using a Local illumination compensation (LIC) method, wherein a first set of LIC parameters of the template of the sub-templates are determined based on a second set of LIC parameters of the first block; and
determining a target motion candidate list based on the reference samples

### Claim 104 (depends on 103)

The method of claim 103, wherein:
the first set of LIC parameters for both left and above templates or sub-templates are the same as the second set of LIC parameters of the first block; or
the first set of LIC parameters for a left template or sub-template are derived as the second set of LIC parameters of the first block; or
the first set of LIC parameters for a above template or sub-template are derived as the second set of LIC parameters of the first block; or
the LIC method is applied when a LIC flag of a corresponding candidate is true; or
the reference samples of the template are derived with a multi-hypothesis prediction method if a corresponding merge candidate uses multi-hypothesis prediction.

### Claim 105 (depends on 88)

The method of claim 88, further comprising:
determining, during a conversion between a second block of a video and a bitstream of the video, reference samples of a template or sub-template of the second block according to an Overlapped Block Motion Compensation (OBMC) method; and
determining a target motion candidate list based on the reference samples of the template or sub-template.

### Claim 106

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, during a conversion between a current block of a video and a bitstream of the video, reference samples of a sub-template of the current block based on a first set of reference samples of the sub-template in a first reference list and a second set of reference samples of the sub-template in a second reference list; and
determine a target motion candidate list based on the reference samples of the sub-template.

### Claim 107

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determining, during a conversion between a current block of a video and a bitstream of the video, reference samples of a sub-template of the current block based on a first set of reference samples of the sub-template in a first reference list and a second set of reference samples of the sub-template in a second reference list; and
determining a target motion candidate list based on the reference samples of the sub-template.
