US 10,771,803 B2Granted

Constrained motion field estimation for hardware efficiency

AssigneeGoogle Inc.

InventorsJingning Han, Yaowu Xu, James Bankoski, Jia Feng

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method for decoding an encoded block of an encoded frame includes selecting motion vectors corresponding to blocks of an extended collocated processing unit in a first reference frame; identifying a block of the blocks, such that the encoded block is a projection, using a motion vector of the block that refers to a third reference frame, onto the encoded frame; on condition that a block is identified, determining a temporal motion vector candidate for the encoded block in a second reference frame using a motion vector of the identified block and respective display orders of the encoded frame, the first reference frame, the second reference frame, and the third reference frame, and adding the temporal motion vector candidate to a motion vector candidate list; selecting a motion vector from the motion vector candidate list; generating a prediction block using the selected motion vector for decoding the encoded block.

Claims20

Dependent claims

A method for decoding an encoded block of an encoded frame, the encoded frame is processed in processing units, wherein a processing unit comprises blocks of the encoded frame including the encoded block, the method comprising:

selecting motion vectors corresponding to blocks of an extended collocated processing unit in a first reference frame;
identifying a reference block of the first reference frame, such that the encoded block is a valid projection, using a motion vector of the reference block that refers to a third reference frame that is different from the encoded frame, onto the encoded frame, wherein the valid projection of the reference block onto the encoded frame using the motion vector of the reference block intersects the encoded frame at the encoded block, and wherein the valid projection comprises a scaling of the motion vector of the reference block using respective display orders of the encoded frame, the first reference frame, and the third reference frame;
determining a temporal motion vector candidate for the encoded block in a second reference frame using a motion vector of the identified reference block and respective display orders of the encoded frame, the first reference frame, the second reference frame, and the third reference frame;
adding the temporal motion vector candidate to a motion vector candidate list;
selecting a motion vector from the motion vector candidate list;
generating a prediction block for the encoded block using the selected motion vector;
and
decoding the encoded block using the prediction block.

5 more elements

An apparatus for coding a current block a current frame, the current frame being processed in processing units, wherein a processing unit comprises blocks of the current frame including the current block, the apparatus performs steps comprising:

projecting a reference block of a first reference frame onto the current frame to identify the current block as a projection of the reference block onto the current frame,
wherein the projecting uses a reference motion vector of the reference block, the reference motion vector refers to a second reference frame that is different from the current frame,
wherein the reference block having a reference location in the first reference frame, and
wherein the current block having a current location in the current frame;
determining a temporal motion vector for the current block by:
on a condition that an absolute difference between the reference location and the current location not exceeding a threshold, determining a first candidate temporal motion vector for the current block in a third reference frame using respective display orders of the current frame, the first reference frame, the second reference frame, and the third reference frame;
and
coding the current block using the temporal motion vector.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/379,062Filed 9 Apr 2019 · continuation
Priority: 28 Sep 2017
Published: US 2019/0098329 A11 Aug 2019
Granted: 8 Sep 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04N 19/51
Involving temporal prediction: motion estimation or motion compensation
H04N 19/176
The unit being an image region, e.g. an object: the region being a block, e.g. a macroblock
H04N 19/182
Characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the…: the…
H04N 19/196
Characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding: being specially adapted for the…

Family

Application15/718,082Parent of this continuation · filed 28 Sep 2017
US 2019/0238879 A1Pre-grant publication · published 1 Aug 2019
US 10,284,869 B2Parent of this continuation
US 2019/0098329 A1Published application
US 10,771,803 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key