# US 12,010,297 B2 · Methods for constructing a merge candidate list

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,297 B2
- Document ID: US12010297B2
- Status: Granted
- Kind: B2
- Application number: 18/052,011
- Filed: 2022-11-02
- Published: 2023-09-21
- Granted: 2024-06-11
- Earliest claimed: 2019-09-19
- Assignees: Alibaba Group Holding Limited
- Applicants: Alibaba Group Holding Limited
- Inventors: Zhao Wang; Yan Ye; Jiancong Luo
- Web page: https://patentgrep.com/patent/US12010297B2

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/513: Processing of motion vectors
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video processing method is provided. The method includes inserting a set of spatial merge candidates to a first merge candidate list of a coding block, wherein the first merge candidate list is constructed by: adding a top neighboring block B1 to the first merge candidate list when the top neighboring block B1 is available; adding a left neighboring block A1 to the first merge candidate list when the left neighboring block A1 is available; adding a top neighboring block B0 to the first merge candidate list when the top neighboring block B0 is available; adding a left neighboring block A0 to the first merge candidate list when the left neighboring block A0 is available; and adding an above-left neighboring block B2 to the first merge candidate list when the above-left neighboring block B2 is available.

## Claims

### Claim 1

A video processing method, comprising:
inserting a set of spatial merge candidates to a first merge candidate list of a coding block,
wherein the first merge candidate list is constructed by:
adding a top neighboring block B1 to the first merge candidate list when the top neighboring block B1 is available;
adding a left neighboring block A1 to the first merge candidate list when the left neighboring block A1 is available;
adding a top neighboring block B0 to the first merge candidate list when the top neighboring block B0 is available;
adding a left neighboring block A0 to the first merge candidate list when the left neighboring block A0 is available; and
adding an above-left neighboring block B2 to the first merge candidate list when the above-left neighboring block B2 is available.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first merge candidate list is selected from a plurality of merge candidate lists based on a coding mode applied to the coding block and wherein the first merge candidate list corresponds to a first coding mode.

### Claim 3 (depends on 2)

The method of claim 2, wherein the plurality of merge candidate lists includes a second merge candidate list corresponding to a second coding mode being applied to the coding block and the second merge candidate list is different from the first merge candidate list.

### Claim 4 (depends on 3)

The method of claim 3, wherein the first and second coding modes are two different modes selected from:
a regular merge mode, a merge mode with motion vector difference (MMVD), and a triangle partition mode (TPM).

### Claim 5 (depends on 3)

The method of claim 3, wherein an order of the second merge candidate list is the left neighboring block A1, the top neighboring block B1, the top neighboring block B0, the left neighboring block, and the above-left neighboring block B2.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures; or
the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures;
wherein the third merge candidate list is different from the first merge candidate list.

### Claim 7 (depends on 6)

The method of claim 6, wherein a merge mode with motion vector difference (MMVD) is applied on the coding block.

### Claim 8

An apparatus for performing video processing, the apparatus comprising:
a memory configured to store instructions; and
one or more processors configured to execute the instructions to cause the apparatus to perform:
inserting a set of spatial merge candidates to a first merge candidate list of a coding block,
wherein the first merge candidate list is constructed by:
adding a top neighboring block B1 to the first merge candidate list when the top neighboring block B1 is available;
adding a left neighboring block A1 to the first merge candidate list when the left neighboring block A1 is available;
adding a top neighboring block B0 to the first merge candidate list when the top neighboring block B0 is available;
adding a left neighboring block A0 to the first merge candidate list when the left neighboring block A0 is available; and
adding an above-left neighboring block B2 to the first merge candidate list when the above-left neighboring block B2 is available.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the first merge candidate list is selected from a plurality of merge candidate lists based on a coding mode applied to the coding block and wherein the first merge candidate list corresponds to a first coding mode.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the plurality of merge candidate lists includes a second merge candidate list corresponding to a second coding mode being applied to the coding block and the second merge candidate list is different from the first merge candidate list.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the first and second coding modes are two different modes selected from:
a regular merge mode, a merge mode with motion vector difference (MMVD), and a triangle partition mode (TPM).

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein an order of the second merge candidate list is the left neighboring block A1, the top neighboring block B1, the top neighboring block B0, the left neighboring block, and the above-left neighboring block B2.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures; or
the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures;
wherein the third merge candidate list is different from the first merge candidate list.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein a merge mode with motion vector difference (MMVD) is applied on the coding block.

### Claim 15

A non-transitory computer readable storage medium storing a bitstream of a video for processing according to a method comprising:
inserting a set of spatial merge candidates to a first merge candidate list of a coding block,
wherein the first merge candidate list is constructed by:
adding a top neighboring block B1 to the first merge candidate list when the top neighboring block B1 is available;
adding a left neighboring block A1 to the first merge candidate list when the left neighboring block A1 is available;
adding a top neighboring block B0 to the first merge candidate list when the top neighboring block B0 is available;
adding a left neighboring block A0 to the first merge candidate list when the left neighboring block A0 is available; and
adding an above-left neighboring block B2 to the first merge candidate list when the above-left neighboring block B2 is available.

### Claim 16 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the first merge candidate list is selected from a plurality of merge candidate lists based on a coding mode applied to the coding block and wherein the first merge candidate list corresponds to a first coding mode.

### Claim 17 (depends on 16)

The non-transitory computer readable storage medium of claim 16, wherein the plurality of merge candidate lists includes a second merge candidate list corresponding to a second coding mode being applied to the coding block and the second merge candidate list is different from the first merge candidate list.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the first and second coding modes are two different modes selected from:
a regular merge mode, a merge mode with motion vector difference (MMVD), and a triangle partition mode (TPM).

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein an order of the second merge candidate list is the left neighboring block A1, the top neighboring block B1, the top neighboring block B0, the left neighboring block, and the above-left neighboring block B2.

### Claim 20 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures; or
the first merge candidate list is selected when the coding block is part of low-delay pictures, and a third merge candidate list is selected when the coding block is part of non-low-delay pictures;
wherein the third merge candidate list is different from the first merge candidate list.
