# US 2017/0289570 A1 · Parallel motion estimation in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289570 A1
- Document ID: US20170289570A1
- Status: Published application
- Kind: A1
- Application number: 15/621,878
- Filed: 2017-06-13
- Published: 2017-10-05
- Earliest claimed: 2011-04-11
- Assignees: Texas Instruments Incorporated
- Applicants: Texas Instruments Incorporated
- Inventors: Minhua Zhou; Vivienne Sze
- Web page: https://patentgrep.com/patent/US20170289570A1

## CPC

- H04N 19/56: Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/436: using parallelised computational arrangements
- H04N 19/52: by predictive encoding
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods for improved parallel motion estimation are provided that decouple the merging candidate list derivation and motion estimation for merge mode and skip mode and the advanced motion vector predictor (AMVP) candidate list construction from regular motion estimation to increase the coding quality in parallel motion estimation while meeting throughput requirements. This decoupling may be accomplished by modifying the availability rules for spatial motion data (SMD) positions for construction of the candidate lists. As part of the decoupling, largest coding units (LCUs) of a picture may be divided into non-overlapping parallel motion estimation regions (PMER) of equal size. Within a PMER, motion estimation for merge mode, skip mode, and normal inter-prediction mode may be performed in parallel for all the prediction units (PUs) in the PMER.

## Claims

### Claim 1

A method for derivation of spatial motion data (SMD) candidates for a prediction unit (PU) in video coding or decoding, the SMD candidates for inclusion in an inter-prediction candidate list for the PU, the method comprising:
determining an SMD position corresponding to an SMD candidate for the PU, wherein the PU is comprised in a parallel motion estimation region (PMER);
selecting at least some motion data of the SMD position as the SMD candidate when the SMD position is not in the PMER and the motion data is available; and
indicating that the SMD candidate is not available when the SMD position is in the PMER.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining an alternative SMD position for the SMD candidate when the SMD position is in the PMER, wherein the alternative SMD position is in a neighboring PMER of the PMER; and
selecting at least some motion data of the alternative SMD position as the SMD candidate when the motion data of the alternative SMD position is available,
wherein indicating that the SMD candidate is not available comprises indicating that the SMD candidate is not available when the SMD position is in the PMER and the motion data of the alternative SMD position is not available.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving an indication of a size of the PMER.

### Claim 4 (depends on 3)

The method of claim 3, wherein the size of the PMER is one selected from a group consisting of 4×4, 8×8, 16×16, 32×32, and 64×64.

### Claim 5 (depends on 1)

The method of claim 1, wherein the SMD position is one selected from a group consisting of a left down neighboring position, an above neighboring position, an above right neighboring position, a left bottom neighboring position, and an above left neighboring position.

### Claim 6 (depends on 2)

The method of claim 2, wherein the SMD position is one selected from a group consisting of a left down neighboring position, an above neighboring position, an above right neighboring position, a left bottom neighboring position, and an above left neighboring position, and
wherein the alternative SMD position for the left down neighboring position is a corresponding position just outside a left boundary of the PMER, the alternative SMD position for the above neighboring position is a corresponding position just outside a top boundary of the PMER, the alternative SMD position for the above right neighboring position is a corresponding position just outside the top boundary of the PMER, the alternative SMD position for the left bottom neighboring position is a corresponding position just outside the left boundary of the PMER, and the alternative SMD position for the above left neighboring position is one selected from a group consisting of a corresponding position just outside the left boundary of the PMER and a corresponding position just outside the top boundary of the PMER.

### Claim 7 (depends on 6)

The method of claim 6, wherein the corresponding position for the left down neighboring positions is at luminance coordinates (xM−1, yP+nPSH−1), the corresponding position for the above neighboring position is at luminance coordinates (xP+nPSW−1, yM−1), the corresponding position for the above right neighboring position is at luminance coordinates (xP+nPSW, yM−1), the corresponding position for the left bottom neighboring position is at luminance coordinates (xM−1, yP+nPSH), the position just outside the left boundary corresponding to the above left neighboring position is at luminance coordinates (xM−1, yP−1), and the position just outside the top boundary corresponding to the above left neighboring position is at luminance coordinates (xP−1, yM−1), wherein (xP, yP) are luminance coordinates of an upper left corner of the PU, (xM, yM) are luminance coordinates of an upper left corner of the PMER, nPSH is a height of the PU, and nPSW is a width of the PU.

### Claim 8 (depends on 1)

The method of claim 1, wherein the SMD candidate one selected from a group consisting of a spatial merging candidate and a spatial motion vector predictor (MVP) candidate.

### Claim 9

A method for parallel motion estimation in a video encoder, the method comprising:
dividing a largest coding unit (LCU) of a picture in a video stream into a plurality of prediction units (PUs) and into a plurality of non-overlapping parallel motion estimation regions (PMERs) of equal size, wherein a PMER of the plurality of PMERs comprises a plurality of the PUs; and
performing motion estimation on the plurality of PUs in the PMER in parallel, wherein parallel motion estimation comprises construction of a merging candidate list for each PU in the PMER by:
determining a spatial motion data (SMD) position corresponding to a spatial merging candidate for the PU;
selecting motion data of the SMD position as the spatial merging candidate when the SMD position is not in the PMER and the motion data is available; and
indicating that the spatial merging candidate is not available when the SMD position is in the PMER.

### Claim 10 (depends on 9)

The method of claim 9, wherein parallel motion estimation further comprises construction of an advanced motion vector prediction (AMVP) list for each PU in the PMER by:
determining an SMD position corresponding to a spatial motion vector predictor (MVP) candidate for the PU;
selecting motion vector data of motion data of the SMD position corresponding to the spatial MVP candidate as the spatial MVP candidate when the SMD position corresponding to the spatial MVP candidate is not in the PMER and the motion data of the SMD position corresponding to the spatial MVP candidate is available; and
indicating that the spatial MVP candidate is not available when the SMD position corresponding to the spatial MVP candidate is in the PMER.

### Claim 11 (depends on 9)

The method of claim 9, wherein construction of a merging candidate list further comprises:
determining an alternative SMD position for the spatial merging candidate when the SMD position is in the PMER, wherein the alternative SMD position is in a neighboring PMER of the PMER; and
selecting motion data of the alternative SMD position as the spatial merging candidate when the motion data of the alternative SMD position is available,
wherein indicating that the spatial merging candidate is not available comprises indicating that the spatial merging candidate is not available when the SMD position is in the PMER and the motion data of the alternative SMD position is not available.

### Claim 12 (depends on 10)

The method of claim 10, wherein construction of an AMVP candidate list further comprises:
determining an alternative SMD position for the spatial MVP candidate when the SMD position corresponding to the spatial MVP candidate is in the PMER, wherein the alternative SMD position for the spatial MVP candidate is in a neighboring PMER of the PMER; and
selecting motion vector data of motion data of the alternative SMD position for the spatial MVP candidate as the spatial MVP candidate when the motion data of the alternative SMD position for the spatial MVP candidate is available,
wherein indicating that the spatial MVP candidate is not available comprises indicating that the spatial MVP candidate is not available when the SMD position corresponding to the spatial MVP candidate is in the PMER and the motion data of the alternative SMD position for the spatial MVP candidate is not available.

### Claim 13 (depends on 9)

The method of claim 9, wherein the SMD position is one selected from a group consisting of a left down neighboring position, an above neighboring position, an above right neighboring position, a left bottom neighboring position, and an above left neighboring position.

### Claim 14 (depends on 11)

The method of claim 11,
wherein the SMD position is one selected from a group consisting of a left down neighboring position, an above neighboring position, an above right neighboring position, a left bottom neighboring position, and an above left neighboring position, and
wherein the alternative SMD position for the left down neighboring position is a corresponding position just outside a left boundary of the PMER, the alternative SMD position for the above neighboring position is a corresponding position just outside a top boundary of the PMER, the alternative SMD position for the above right neighboring position is a corresponding position just outside the top boundary of the PMER, the alternative SMD position for the left bottom neighboring position is a corresponding position just outside the left boundary of the PMER, and the alternative SMD position for the above left neighboring position is one selected from a group consisting of a corresponding position just outside the left boundary of the PMER and a corresponding position just outside the top boundary of the PMER.

### Claim 15 (depends on 9)

The method of claim 9, wherein a size of a PMER is configurable.

### Claim 16

A method for decoding an encoded video bit stream in a video decoder, the method comprising:
receiving a size of parallel motion estimation regions (PMERs) in an encoded largest coding unit (LCU) in encoded video stream; and
decoding the encoded LCU, wherein the decoding comprises construction of a merging candidate list for a first inter-predicted PU comprised in a first PMER of the encoded LCU by:
determining a spatial motion data (SMD) position corresponding to a spatial merging candidate for the first inter-predicted PU;
selecting motion data of the SMD position as the spatial merging candidate when the SMD position is not in the first PMER and the motion data is available; and
indicating that the spatial merging candidate is not available when the SMD position is in the first PMER.

### Claim 17 (depends on 16)

The method of claim 16, wherein the decoding further comprises construction of an advanced motion vector prediction (AMVP) list for a second inter-predicted PU in a second PMER of the encoded LCU by:
determining an SMD position corresponding to a spatial motion vector predictor (MVP) candidate for the second inter-predicted PU;
selecting motion vector data of motion data of the SMD position corresponding to the spatial MVP candidate as the spatial MVP candidate when the SMD position corresponding to the spatial MVP candidate is not in the second PMER and the motion data of the SMD position corresponding to the spatial MVP candidate is available; and
indicating that the spatial MVP candidate is not available when the SMD position corresponding to the spatial MVP candidate is in the second PMER.

### Claim 18 (depends on 16)

The method of claim 16, wherein construction of a merging candidate list further comprises:
determining an alternative SMD position for the spatial merging candidate when the SMD position is in the first PMER, wherein the alternative SMD position is in a neighboring PMER of the first PMER; and
selecting motion data of the alternative SMD position as the spatial merging candidate when the motion data of the alternative SMD position is available,
wherein indicating that the spatial merging candidate is not available comprises indicating that the spatial merging candidate is not available when the SMD position is in the first PMER and the motion data of the alternative SMD position is not available.

### Claim 19 (depends on 17)

The method of claim 17, wherein construction of an AMVP candidate list further comprises:
determining an alternative SMD position for the spatial MVP candidate when the SMD position corresponding to the spatial MVP candidate is in the second PMER, wherein the alternative SMD position for the spatial MVP candidate is in a neighboring PMER of the second PMER; and
selecting motion vector data of motion data of the alternative SMD position for the spatial MVP candidate as the spatial MVP candidate when the motion data of the alternative SMD position for the spatial MVP candidate is available,
wherein indicating that the spatial MVP candidate is not available comprises indicating that the spatial MVP candidate is not available when the SMD position corresponding to the spatial MVP candidate is in the second PMER and the motion data of the alternative SMD position for the spatial MVP candidate is not available.

### Claim 20 (depends on 18)

The method of claim 18,
wherein the SMD position is one selected from a group consisting of a left down neighboring position, an above neighboring position, an above right neighboring position, a left bottom neighboring position, and an above left neighboring position, and
wherein the alternative SMD position for the left down neighboring position is a corresponding position just outside a left boundary of the first PMER, the alternative SMD position for the above neighboring position is a corresponding position just outside a top boundary of the first PMER, the alternative SMD position for the above right neighboring position is a corresponding position just outside the top boundary of the first PMER, the alternative SMD position for the left bottom neighboring position is a corresponding position just outside the left boundary of the first PMER, and the alternative SMD position for the above left neighboring position is one selected from a group consisting of a corresponding position just outside the left boundary of the first PMER and a corresponding position just outside the top boundary of the first PMER.
