# US 2016/0366435 A1 · Sub-prediction unit motion vector prediction using spatial and/or temporal motion information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0366435 A1
- Document ID: US20160366435A1
- Status: Published application
- Kind: A1
- Application number: 15/176,790
- Filed: 2016-06-08
- Published: 2016-12-15
- Earliest claimed: 2015-06-11
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Wei-Jung Chien; Xianglin Wang; Li Zhang; Hongbin Liu; Jianle Chen; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20160366435A1

## CPC

- H04N 19/52: by predictive encoding
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In one example, a device for decoding video data includes a memory configured to store video data and a video decoder configured to determine that a motion prediction candidate for a current block of video data indicates that motion information is to be derived for sub-blocks of the current block, in response to the determination: partition the current block into the sub-blocks, for each of the sub-blocks, derive motion information using motion information for at least two neighboring blocks, and decode the sub-blocks using the respective derived motion information.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
determining that a motion prediction candidate for a current block of video data indicates that motion information is to be derived for sub-blocks of the current block;
in response to the determination:
partitioning the current block into the sub-blocks;
for each of the sub-blocks, deriving motion information using motion information for at least two neighboring blocks; and
decoding the sub-blocks using the respective derived motion information.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least two neighboring blocks are selected from a group including an above-neighboring block, a left-neighboring block, and a temporally neighboring block.

### Claim 3 (depends on 2)

The method of claim 2, wherein the above-neighboring block comprises an above-neighboring sub-block within the current block.

### Claim 4 (depends on 2)

The method of claim 2, wherein the left-neighboring block comprises a left-neighboring sub-block within the current block.

### Claim 5 (depends on 2)

The method of claim 2, wherein the above-neighboring block comprises an above-neighboring sub-block outside of the current block.

### Claim 6 (depends on 2)

The method of claim 2, wherein the left-neighboring block comprises a left-neighboring sub-block outside of the current block.

### Claim 7 (depends on 2)

The method of claim 2, wherein the temporally neighboring block comprises a block in a previously decoded picture that neighbors a block that is co-located with the current block in the previously decoded picture.

### Claim 8 (depends on 2)

The method of claim 2, wherein deriving the motion information comprises deriving the motion information using an average of the motion information for the above-neighboring block, the left-neighboring block, and the temporally neighboring block.

### Claim 9 (depends on 1)

The method of claim 1, wherein the neighboring blocks have sizes equal to or less than sizes of the sub-blocks.

### Claim 10 (depends on 1)

The method of claim 1, further comprising decoding data representative of a size of the sub-blocks.

### Claim 11 (depends on 10)

The method of claim 10, wherein decoding the data representative of the size of the sub-blocks comprises decoding the data in at least one of a slice header, a sequence parameter set (SPS), or a picture parameter set (PPS).

### Claim 12 (depends on 1)

The method of claim 1, wherein deriving the motion information comprises scaling motion information for the neighboring blocks to a common reference picture.

### Claim 13 (depends on 1)

The method of claim 1, wherein deriving the motion information comprises deriving a motion vector (MV) for each of the sub-blocks according to the following formula, where wi represents a horizontal weighting factor, wj represents a vertical weighting factor, Oi represents a horizontal offset value, and Oj represents a vertical offset value:
(MVx,MVy)=((Σi=02MVxi+sign(Σi=02MVxi)*1)*43/128,(Σi=02MVyi+sign(−Σi=02MVyi)*1)*43/128)).

### Claim 14 (depends on 1)

The method of claim 1, further comprising adding the motion prediction candidate to a candidate list.

### Claim 15 (depends on 1)

The method of claim 1, further comprising encoding the sub-blocks prior to decoding the sub-blocks, the method further comprising encoding data that identifies the motion prediction candidate for the current block.

### Claim 16 (depends on 1)

The method of claim 1, the method being executable on a wireless communication device, wherein the device comprises:
a memory configured to store the video data;
a processor configured to execute instructions to process the video data stored in the memory; and
a receiver configured to receive an encoded version of the video data.

### Claim 17 (depends on 16)

The method of claim 16, wherein the wireless communication device is a cellular telephone and the encoded video data is received by the receiver and modulated according to a cellular communication standard.

### Claim 18

A device for decoding video data, the device comprising:
a memory configured to store video data; and
a video decoder configured to:
determine that a motion prediction candidate for a current block of the video data indicates that motion information is to be derived for sub-blocks of the current block;
in response to the determination:
partition the current block into the sub-blocks;
for each of the sub-blocks, derive motion information using motion information for at least two neighboring blocks; and
decode the sub-blocks using the respective derived motion information.

### Claim 19 (depends on 18)

The device of claim 18, wherein to derive the motion information, the video decoder is configured to, for each of the sub-blocks, derive the motion information using an above-neighboring sub-block, a left-neighboring sub-block, and a temporally neighboring sub-block.

### Claim 20 (depends on 19)

The device of claim 19,
wherein the above-neighboring sub-block comprises an above-neighboring sub-block within the current block or outside the current block, and
wherein the left-neighboring sub-block comprises a left-neighboring sub-block within the current block or outside the current block.

### Claim 21 (depends on 18)

The device of claim 18, wherein the video decoder is further configured to decode data representative of a size of the sub-blocks from at least one of a slice header, a sequence parameter set (SPS), or a picture parameter set (PPS).

### Claim 22 (depends on 18)

The device of claim 18, wherein the video decoder is further configured to scale motion information for the neighboring blocks to a common reference picture.

### Claim 23 (depends on 18)

The device of claim 18, further comprising a video encoder configured to encode the sub-blocks before the video decoder decodes the sub-blocks.

### Claim 24 (depends on 18)

The device of claim 18, wherein the device is a wireless communication device, further comprising:
a receiver configured to receive an encoded version of the video data.

### Claim 25 (depends on 24)

The device of claim 24, wherein the wireless communication device is a cellular telephone and the encoded video data is received by the receiver and modulated according to a cellular communication standard.

### Claim 26

A device for decoding video data, the device comprising:
means for determining that a motion prediction candidate for a current block of video data indicates that motion information is to be derived for sub-blocks of the current block;
means for partitioning the current block into the sub-blocks in response to the determination;
means for deriving, for each of the sub-blocks, motion information using motion information for at least two neighboring blocks in response to the determination; and
means for decoding the sub-blocks using the respective derived motion information in response to the determination.

### Claim 27 (depends on 26)

The device of claim 26, wherein the means for deriving the motion information comprises means for deriving, for each of the sub-blocks, the motion information using an above-neighboring sub-block, a left-neighboring sub-block, and a temporally neighboring sub-block.

### Claim 28 (depends on 27)

The device of claim 27,
wherein the above-neighboring sub-block comprises an above-neighboring sub-block within the current block or outside the current block, and
wherein the left-neighboring sub-block comprises a left-neighboring sub-block within the current block or outside the current block.

### Claim 29 (depends on 26)

The device of claim 26, further comprising means for encoding the sub-blocks before the means for decoding decodes the sub-blocks.

### Claim 30

A computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to:
determine that a motion prediction candidate for a current block of video data indicates that motion information is to be derived for sub-blocks of the current block;
in response to the determination:
partition the current block into the sub-blocks;
for each of the sub-blocks, derive motion information using motion information for at least two neighboring blocks; and
decode the sub-blocks using the respective derived motion information.
