# US 11,122,285 B2 · Sub-prediction unit temporal motion vector prediction (sub-PU TMVP) for video coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,285 B2 - Document ID: US11122285B2 - Status: Granted - Kind: B2 - Application number: 16/743,631 - Filed: 2020-01-15 - Published: 2020-05-14 - Granted: 2021-09-14 - Earliest claimed: 2017-03-30 - Assignees: Mediatek Inc. - Applicants: Mediatek Inc. - Inventors: Chun-Chia Chen; Chih-Wei Hsu; Ching-Yeh Chen; Yu-Wen Huang - Web page: https://patentgrep.com/patent/US11122285B2 ## CPC - H04N 19/51: Motion estimation or motion compensation - G06F 16/7837: {using objects detected or recognised in the video content} - H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/513: Processing of motion vectors - H04N 19/52: by predictive encoding - H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Aspects of the disclosure provide a video coding method for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode. The method can include receiving the current PU including sub-PUs, determining an initial motion vector that is a motion vector of a spatial neighboring block of the current PU, performing a searching process to search for a main collocated picture in a sequence of reference pictures of the current PU based on the initial motion vector, and obtaining collocated motion information in the main collocated picture for the sub-PUs of the current PU. The searching process can include turning on motion vector scaling operation for searching a subset of the sequence of reference pictures, and turning off the motion vector scaling operation for searching the other reference pictures in the sequence of reference pictures. ## Claims ### Claim 1 A video coding method for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode, comprising: receiving the current PU including sub-PUs; determining a main collocated picture; determining an initial motion vector for said sub-PUs; determining collocated sub-PUs in the main collocated picture according to the initial motion vector; and obtaining collocated motion information of the collocated sub-PUs in the main collocated picture for deriving motion vectors of the sub-PUs of the current PU. ### Claim 2 (depends on 1) The video coding method of claim 1, wherein the main collocated picture is a temporal collocated picture. ### Claim 3 (depends on 1) The video coding method of claim 1, wherein said collocated sub-PUs are temporal collocated sub-PUs. ### Claim 4 (depends on 1) The video coding method of claim 1, wherein the collocated motion information of the collocated sub-PUs comprises motion vectors and associated reference indexes of said collocated sub-PUs. ### Claim 5 (depends on 1) The video coding method of claim 1, wherein the main collocated picture is determined by an encoder side. ### Claim 6 (depends on 1) The video coding method of claim 1, wherein the main collocated picture is pre-determined. ### Claim 7 (depends on 1) The video coding method of claim 1, further comprising signaling or parsing the main collocated picture. ### Claim 8 (depends on 7) The video coding method of claim 7, wherein the signaling or parsing is in sequence level, picture level, slice level or prediction unit (PU) level. ### Claim 9 (depends on 1) The video coding method of claim 1, wherein the main collocated picture associates with the initial motion vector. ### Claim 10 A video coding apparatus for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode, comprising circuitry configured to: receive the current PU including sub-PUs; determining a main collocated picture; determine an initial motion vector for said sub-PUs that is a motion vector of a spatial neighboring block of the current PU; determine collocated sub-PUs in the main collocated picture according to the initial motion vector; and obtain collocated motion information of the collocated sub-PUs in the main collocated picture for deriving motion vectors of the sub-PUs of the current PU. ### Claim 11 (depends on 10) The video coding apparatus of claim 10, wherein the main collocated picture is a temporal collocated picture. ### Claim 12 (depends on 10) The video coding apparatus of claim 10, wherein said collocated sub-PUs are temporal collocated sub-PUs. ### Claim 13 (depends on 10) The video coding apparatus of claim 10, wherein the collocated motion information of the collocated sub-PUs comprises motion vectors and associated reference indexes of said collocated sub-PUs. ### Claim 14 (depends on 10) The video coding apparatus of claim 10, wherein the main collocated picture is determined by an encoder side. ### Claim 15 (depends on 10) The video coding apparatus of claim 10, wherein the main collocated picture is pre-determined. ### Claim 16 (depends on 10) The video coding apparatus of claim 10, wherein the circuitry is further configured to: signal or parse the main collocated picture. ### Claim 17 (depends on 16) The video coding apparatus of claim 16, wherein the signaling or parsing is in sequence level, picture level, slice level or prediction unit (PU) level. ### Claim 18 (depends on 10) The video coding apparatus of claim 10, wherein the main collocated picture associates with the initial motion vector. ### Claim 19 A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to perform a video coding method for processing a current prediction unit (PU) with a sub-PU temporal motion vector prediction (TMVP) mode, the method comprising: receiving the current PU including sub-PUs; determining a main collocated picture; determining an initial motion vector for said sub-PUs; determining collocated sub-PUs in the main collocated picture based on the initial motion vector; and obtaining collocated motion information of the collocated sub-PUs in the main collocated picture for deriving motion vectors of the sub-PUs of the current PU.