# US 2020/0404253 A1 · Inter modes with weighting-averaged prediction, symmetric mvd or affine motion in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404253 A1
- Document ID: US20200404253A1
- Status: Published application
- Kind: A1
- Application number: 16/909,772
- Filed: 2020-06-23
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Chun-Chi Chen; Wei-Jung Chien; Han Huang; Yao-Jen Chang; Kevin Pascal Andre Reuze; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20200404253A1

## CPC

- G11B 33/14: Reducing influence of physical parameters, e.g. temperature change, moisture, dust
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- B23K 20/127: {Friction stir welding involving a mechanical connection}
- B23P 15/00: Making specific metal objects by operations not covered by a single other subclass or a group in this subclass
- C21D 9/0068: {for particular articles not mentioned below}
- C22F 1/04: of aluminium or alloys based thereon
- G11B 33/1406: {Reducing the influence of the temperature}
- G11B 33/1486: {Control/regulation of the pressure, e.g. the pressure inside the housing of a drive}
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- B23K 20/122: {using a non-consumable tool, e.g. friction stir welding}
- B23K 26/21: by welding
- B23K 2101/36: Electric or electronic devices
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B23K: SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23P: METAL-WORKING NOT OTHERWISE PROVIDED FOR; COMBINED OPERATIONS; UNIVERSAL MACHINE TOOLS (arrangements for copying or controlling B23Q)
- C21D: MODIFYING THE PHYSICAL STRUCTURE OF FERROUS METALS; GENERAL DEVICES FOR HEAT TREATMENT OF FERROUS OR NON-FERROUS METALS OR ALLOYS; MAKING METAL MALLEABLE, e.g. BY DECARBURISATION OR TEMPERING (surface treatment of metallic material involving at least one process provided for in class C23 and at least one process covered by this subclass C23F17/00; unidirectional solidification of eutectic materials or unidirectional demixing of eutectoid materials C30B)
- C22F: CHANGING THE PHYSICAL STRUCTURE OF NON-FERROUS METALS AND NON-FERROUS ALLOYS (surface treatment of metallic material involving at least one process provided for in class C23 and at least one process covered by this subclass, C23F17/00)

## Abstract

A video coder is configured to form, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and a List 1 (L1) base vector using a L1 AMVP candidate list; determine a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector; and use the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of the video data.

## Claims

### Claim 1

A method of coding video data, the method comprising:
forming, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and forming a List 1 (L1) base vector using a L1 AMVP candidate list;
determining a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector, wherein the refined L0 motion vector indicates a location in an L0 reference picture in a reference picture list L0 and the refined L0 motion vector indicates a location in an L1 reference picture in a reference picture list L1; and
using the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of the video data.

### Claim 2 (depends on 1)

The method of claim 1, wherein forming the L0 base vector using the L0 AMVP candidate list and forming the L1 base vector using the L1 AMVP candidate list comprises:
determining the L0 reference picture and the L1 reference picture, wherein the L0 reference picture is a nearest reference picture to the current picture in L0, the L1 reference picture is a nearest reference picture to the current picture in L1, and the L0 reference picture and L1 reference picture form a forward and backward pair or a backward and forward pair;
determining a L0 motion vector predictor (MVP) flag, a L1 MVP flag, and a L0 motion vector difference (MVD);
determining a L1 MVD by mapping the L0 MVD to L1;
forming the L0 base vector as the L0 MVD plus a motion vector in the L0 AMVP candidate list indicated by the L0 MVP flag; and
forming the L1 base vector as the L1 MVD plus a motion vector in the L1 AMVP candidate list indicated by the L1 MVP flag.

### Claim 3 (depends on 2)

The method of claim 2, wherein a video coding standard according to which the video data is coded imposes a constraint that requires the L0 reference picture and the L1 reference picture to have equal Picture Order Count (POC) distances from the current picture.

### Claim 4 (depends on 2)

The method of claim 2, wherein determining the L1 MVD comprises scaling an absolute value of the L0 MVD using a scaling factor of N/M, where N indicates a POC distance from the L1 reference picture to the current picture and M indicates a POC distance from the L0 reference picture to the current picture.

### Claim 5 (depends on 2)

The method of claim 2, wherein determining the L0 reference picture and the L1 reference picture comprises determining a L0 reference index and a L1 reference index from a first-available bi-directional candidate in a merge candidate list, wherein the L0 reference index indicates a position in L0 of the L0 reference picture and the L1 reference index indicates a position in L1 of the L1 reference picture.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the current block is a coding unit (CU),
the method further comprises:
inverse quantizing a transform coefficient block, wherein the transform coefficient block includes a DC transform coefficient;
applying an inverse transform to the inverse quantized transform coefficient block to generate residual data;
prior to reconstructing the current block based on the prediction block, adding an offset value to prediction samples of the prediction block of the CU, wherein the offset value is smaller than a quantization step size of the DC transform coefficient, and
reconstructing the current block based on the prediction block by combining the prediction block and the residual block.

### Claim 7

A device for coding video data, the device comprising:
a memory to store the video data; and
one or more processors implemented in circuitry, the one or more processors configured to:
form, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and form a List 1 (L1 ) base vector using a L1 AMVP candidate list;
determine a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector, wherein the refined L0 motion vector indicates a location in an L0 reference picture in a reference picture list L0 and the refined L0 motion vector indicates a location in an L1 reference picture in a reference picture list L1; and
use the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of the video data.

### Claim 8 (depends on 7)

The device of claim 7, wherein the one or more processors are configured such that, as part of forming the L0 base vector using the L0 AMVP candidate list and the L1 base vector using the L1 AMVP candidate list, the one or more processors:
determine a L0 reference picture and a L1 reference picture, wherein the L0 reference picture is a nearest reference picture to the current picture in L0, the L1 reference picture is a nearest reference picture to the current picture in L1, and the L0 reference picture and the L1 reference picture form a forward and backward pair or a backward and forward pair;
obtain a L0 motion vector predictor (MVP) flag, a L1 MVP flag, and a L0 motion vector difference (MVD);
determine a L1 MVD by mapping the L0 MVD to L1;
form the L0 base vector as the L0 MVD plus a motion vector in the L0 AMVP candidate list indicated by the L0 MVP flag; and
form the L1 base vector as the L1 MVD plus a motion vector in the L1 AMVP candidate list indicated by the L1 MVP flag.

### Claim 9 (depends on 8)

The device of claim 8, wherein a video coding standard according to which the video data is coded imposes a constraint that requires the L0 reference picture and the L1 reference picture to have equal Picture Order Count (POC) distances from the current picture.

### Claim 10 (depends on 8)

The device of claim 8, wherein the one or more processors are configured such that, as part of determining the L1 MVD, the one or more processors scale an absolute value of the L0 MVD using a scaling factor of N/M, where N indicates a POC distance from the L1 reference picture to the current picture and M indicates a POC distance from the L0 reference picture to the current picture.

### Claim 11 (depends on 8)

The device of claim 8, wherein the one or more processors are configured such that, as part of determining the L0 reference picture and the L1 reference picture, the one or more processors determine a L0 reference index and a L1 reference index from a first-available bi-directional candidate in a merge candidate list, wherein the L0 reference index indicates a position in L0 of the L0 reference picture and the L1 reference index indicates a position in L1 of the L1 reference picture.

### Claim 12 (depends on 7)

The device of claim 7, wherein:
the block is a coding unit (CU), and
the one or more processors are further configured to:
decode a transform coefficient block, wherein the transform coefficient block includes a DC transform coefficient;
inverse quantize the transform coefficient block;
apply an inverse transform to the inverse quantized transform coefficient block to generate residual data;
prior to reconstructing the current block based on the prediction block, add an offset value to prediction samples of the prediction block of the CU, wherein the offset value is smaller than a quantization step size of the DC transform coefficient, and
reconstruct the current block based on the prediction block comprises combining the prediction block and the residual block.

### Claim 13 (depends on 7)

The device of claim 7, further comprising a display configured to display decoded video data.

### Claim 14 (depends on 7)

The device of claim 7, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

### Claim 15

A computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:
form, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and form a List 1 (L1 ) base vector using a L1 AMVP candidate list;
determine a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector, wherein the refined L0 motion vector indicates a location in an L0 reference picture in a reference picture list L0 and the refined L0 motion vector indicates a location in an L1 reference picture in a reference picture list L1; and
use the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of video data.

### Claim 16 (depends on 15)

The computer-readable storage medium of claim 15, wherein the instructions that cause the one or more processors to form the L0 base vector using the L0 AMVP candidate list and the L1 base vector using the L1 AMVP candidate list comprise instructions that cause the one or more processors to:
determine a L0 reference picture and a L1 reference picture, wherein the L0 reference picture is a nearest reference picture to the current picture in L0, the L1 reference picture is a nearest reference picture to the current picture in L1, and the L0 reference picture and the L1 reference picture form a forward and backward pair or a backward and forward pair;
obtain a L0 motion vector predictor (MVP) flag, a L1 MVP flag, and a L0 motion vector difference (MVD);
determine a L1 MVD by mapping the L0 MVD to L1;
form the L0 base vector as the L0 MVD plus a motion vector in the L0 AMVP candidate list indicated by the L0 MVP flag; and
form the L1 base vector as the L1 MVD plus a motion vector in the L1 AMVP candidate list indicated by the L1 MVP flag.

### Claim 17 (depends on 16)

The computer-readable storage medium of claim 16, wherein a video coding standard according to which the video data is coded imposes a constraint that requires the L0 reference picture and the L1 reference picture to have equal Picture Order Count (POC) distances from the current picture.

### Claim 18 (depends on 16)

The computer-readable storage medium of claim 16, wherein the instructions that cause the one or more processors to determine the L1 MVD comprises instructions that cause the one or more processors to scale an absolute value of the L0 MVD using a scaling factor of N/M, where N indicates a POC distance from the L1 reference picture to the current picture and M indicates a POC distance from the L0 reference picture to the current picture.

### Claim 19 (depends on 16)

The computer-readable storage medium of claim 16, wherein the instructions that cause the one or more processors to determine the L0 reference picture and the L1 reference picture comprise instructions that cause the one or more processors to determine a L0 reference index and a L1 reference index from a first-available bi-directional candidate in a merge candidate list, wherein the L0 reference index indicates a position in L0 of the L0 reference picture and the L1 reference index indicates a position in L1 of the L1 reference picture.

### Claim 20 (depends on 15)

The computer-readable storage medium of claim 15, wherein:
the block is a coding unit (CU),
execution of the instructions further causes the one or more processors to:
inverse quantize a transform coefficient block, wherein the transform coefficient block includes a DC transform coefficient;
apply an inverse transform to the inverse quantized transform coefficient block to generate residual data;
prior to reconstructing the current block based on the prediction block, add an offset value to prediction samples of the prediction block of the CU,
wherein the offset value is smaller than a quantization step size of the DC transform coefficient, and
reconstruct the current block based on the prediction block comprises combining the prediction block and the residual block.
