# US 2021/0176485 A1 · Method and Apparatus of Motion Vector Constraint for Video Coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176485 A1
- Document ID: US20210176485A1
- Status: Published application
- Kind: A1
- Application number: 16/613,674
- Filed: 2018-05-17
- Published: 2021-06-10
- Earliest claimed: 2017-05-18
- Assignees: Mediatek Inc.
- Applicants: Mediatek Inc.
- Inventors: Tzu-Der CHUANG; Ching-Yeh CHEN; Yu-Wen HUANG; Chih-Wei HSU
- Web page: https://patentgrep.com/patent/US20210176485A1

## CPC

- H04N 19/52: by predictive encoding
- H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/189: characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N 19/513: Processing of motion vectors
- H04N 19/54: using feature points or meshes
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.

## Claims

### Claim 1

A method of video coding using an inter-prediction mode in a video coding system, the method comprising:
receiving input data associated with a current block in a current picture;
when a sub-block motion compensation coding tool is selected for the current block:
generating sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks;
constraining the sub-block MVs within a range to form constrained sub-block MVs; and
applying motion compensation to the current block using the constrained sub-block MVs or applying motion compensation to the current block using one sub-block MV within the range in a second list if a corresponding sub-block MV in a first list is outside the range.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sub-block motion compensation coding tool is selected from a group comprising ATMVP (Advanced Temporal Motion Vector Prediction), STMVP (Spatial-Temporal Motion Vector Prediction), affine prediction, and sub-block refined PMVD (Pattern-based Motion Vector Derivation) mode.

### Claim at position 3

3-6. (canceled)

### Claim 7 (depends on 2)

The method of claim 2, wherein, for the affine prediction, the primary MV corresponds to one of control-point MVs, one of the sub-block MVs of the current block, or one derived MV.

### Claim 8 (depends on 7)

The method of claim 7, wherein said one of the sub-block MVs of the current block corresponds to one MV of one corner sub-block or one MV of one centre sub-block, or said one derived MV corresponds to one derived MV using one centre pixel or centre block of the current block.

### Claim 9

(canceled)

### Claim 10 (depends on 1)

The method of claim 1, wherein said constraining the sub-block MVs within the range around the primary MV comprises restricting a difference between the primary MV and each sub-block MV of the sub-block MVs within one or more thresholds.

### Claim 11 (depends on 10)

The method of claim 10, wherein each sub-block MV of the sub-block MVs is restricted to the range from (primary MV−Threshold) to (primary MV+Threshold), wherein Threshold corresponds to one threshold and if one sub-block MV is outside the range, the sub-block MV is clipped to the range.

### Claim 12 (depends on 10)

The method of claim 10, wherein each of said one or more thresholds corresponds to a predefined value, a derived value or a signalled value.

### Claim 13

(canceled)

### Claim 14 (depends on 10)

The method of claim 10, wherein said one or more thresholds are determined depending on size, width or height of the current block or current sub-block, the primary MV, inter prediction direction of the current block or the current sub-block, or the combination of the above.

### Claim 15

(canceled)

### Claim 16 (depends on 1)

The method of claim 1, wherein, when the sub-block motion compensation coding tool is selected for the current block at a video encoder, the video encoder constrains the sub-block MVs to be within the range to form constrained sub-block MVs and signals information related to the constrained sub-block MVs in a video bitstream.

### Claim 17

(canceled)

### Claim 18 (depends on 1)

The method of claim 1, wherein the sub-block MVs is constrained within a range around a primary MV.

### Claim 19 (depends on 1)

The method of claim 1, wherein, when the sub-block motion compensation coding tool is selected for the current block at a video encoder, all the sub-block MVs are restricted to be within a range around a primary MV and signals information related to the sub-block MVs in a video bitstream.

### Claim 20

An apparatus of video coding using an inter-prediction mode in a video coding system, the apparatus comprising one or more electronic devices or processors configured to:
receive input data associated with a current block in a current picture;
when a sub-block motion compensation coding tool is selected for the current block:
generate sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks;
constrain the sub-block MVs within a range to form constrained sub-block MVs; and
apply motion compensation to the current block using the constrained sub-block MVs or apply motion compensation to the current block using one sub-block MV within the range in a second list if a corresponding sub-block MV in a first list is outside the range around the primary MV.

### Claim 21

A method of video coding using an inter-prediction mode in a video coding system, the method comprising:
receiving input data associated with a current block in a current picture;
when a sub-block motion compensation coding tool is selected for the current block:
deriving a primary reference block ;
generating sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks; and
applying motion compensation to the current block using one or more reference pixels of reference sub-blocks within the primary reference block and excluding any reference pixel of reference sub-blocks outside the primary reference block, wherein the reference sub-blocks are pointed by sub-block MVs.

### Claim 22 (depends on 21)

The method of claim 21, wherein the primary reference block covering a reference block pointed by a primary MV.

### Claim 23 (depends on 21)

The method of claim 21, wherein any reference pixel of reference sub-blocks outside the primary reference block is replaced by a pseudo reference pixel.

### Claim 24 (depends on 23)

The method of claim 23, wherein the pseudo reference pixel corresponds to a predefined pixel value or a padding pixel of the primary reference block.

### Claim 25 (depends on 21)

The method of claim 21, wherein interpolation filter coefficients are modified to exclude any reference pixel of reference sub-blocks outside the primary reference block.

### Claim 26 (depends on 21)

The method of claim 21, wherein size and shape of the primary reference block is determined according to size and shape of the current block or current sub-block, the primary MV, inter prediction direction of the current or the current sub-block, or the combination of the above.

### Claim 27 (depends on 21)

The method of claim 21, wherein the sub-block motion compensation coding tool is selected from a group comprising ATMVP (Advanced Temporal Motion Vector Prediction), STMVP (Spatial-Temporal Motion Vector Prediction), affine prediction, and sub-block refined PMVD (Pattern-based Motion Vector Derivation) mode.

### Claim 28

An apparatus of video coding using an inter-prediction mode in a video coding system, the apparatus comprising one or more electronic devices or processors configured to:
receive input data associated with a current block in a current picture;
when a sub-block motion compensation coding tool is selected for the current block:
derive a primary reference block;
generate sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks; and
apply motion compensation to the current block using one or more reference pixels of reference sub-blocks within the primary reference block and exclude any reference pixel of reference sub-blocks outside the primary reference block, wherein the reference sub-blocks are pointed by sub-block MVs.
