# US 12,015,800 B2 · MMVD and SMVD combination with motion and prediction models > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,800 B2 - Document ID: US12015800B2 - Status: Granted - Kind: B2 - Application number: 17/414,598 - Filed: 2019-12-16 - Published: 2022-03-10 - Granted: 2024-06-18 - Earliest claimed: 2018-12-17 - Assignees: InterDigital Madison Patent Holdings, SAS - Applicants: Interdigital Madison Patent Holdings, SAS - Inventors: Fabrice Leleannec; Franck Galpin; Edouard Francois - Web page: https://patentgrep.com/patent/US12015800B2 ## CPC - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/109: among a plurality of temporal predictive coding modes - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/52: by predictive encoding - H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures - H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The general aspects extend motion modes, such as merge with motion vector difference, and symmetrical motion vector difference, to motion models beyond a simple translational model, for example in combination with merge and alternative temporal motion vector prediction modes. Embodiments extend the use of MMVD and SMVD motion vector coding tools to all the motion model derivation methods and temporal prediction methods that are supported in proposed video standards, so as to increase the overall compression performance. Particular embodiments describe combining MMVD or SMVD with the affine motion model, the ATMVP motion model, the planar motion model, the regressive motion field, the triangle-partition-based motion model, the GBI temporal prediction method, the LIC temporal prediction method and the Multi-hypothesis prediction method. ## Claims ### Claim 1 A method, comprising: indicating use of a merge mode with motion vector difference through syntax in a video bitstream; indicating use of a bi-prediction mode through syntax in the video bitstream; and, responsive to the syntaxes: encoding a first set of merge mode with motion vector difference indices for a first reference picture; obtaining a second set of merge mode with motion vector difference indices wherein a direction index for said second set is obtained based on a direction index encoded for said first set; encoding the second set without said direction index; and encoding a block of a current picture using indices of said first and second sets. ### Claim 2 An apparatus, comprising: a processor, configured to: indicate use of a merge mode with motion vector difference through syntax in a video bitstream; indicate use of a bi-prediction mode through syntax in the video bitstream; and, responsive to the syntaxes: encode a first set of merge mode with motion vector difference indices for a first reference picture; obtain a second set of merge mode with motion vector difference indices wherein a direction index for said second set is obtained based on a direction index encoded for said first set; encode the second set without said direction index; and encode a block of a current picture using indices of said first and second sets. ### Claim 3 A method, comprising: parsing a video bitstream for syntax indicative of use of a merge mode with motion vector difference; parsing the video bitstream for syntax indicative of use of a bi-prediction mode; and, responsive to at least one of said syntaxes: decoding a first set of merge mode with motion vector difference indices for a first reference picture; obtaining a second set of merge mode with motion vector difference indices for a second reference picture, wherein a direction index for said second set is obtained based on a direction index decoded for said first set; and decoding a block of a current picture using indices of said first and second sets. ### Claim 4 An apparatus, comprising: a processor, configured to: parse a video bitstream for syntax indicative of use of a merge mode with motion vector difference; parse the video bitstream for syntax indicative of use of a bi-prediction mode; and, responsive to at least one of said syntaxes: decode a first set of merge mode with motion vector difference indices for a first reference picture; obtain a second set of merge mode with motion vector difference indices for a second reference picture, wherein a direction index for said second set is obtained based on a direction index decoded for said first set; and decode a block of a current picture using indices of said first and second sets. ### Claim 5 (depends on 4) A device comprising: the apparatus of claim 4; and at least one of (i) an antenna configured to receive a signal, the signal including the block of the current picture, (ii) a band limiter configured to limit the received signal to a band of frequencies that includes the block of the current picture, and (iii) a display configured to display an output representative of the block of the current picture. ### Claim 6 (depends on 1) A non-transitory computer readable medium containing data content generated according to the method of claim 1, for playback using a processor. ### Claim 7 (depends on 3) A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 3. ### Claim 8 (depends on 1) The method of claim 1, wherein encoding the second set comprises encoding a distance index for said second set. ### Claim 9 (depends on 1) The method of claim 1, wherein in the case where said first reference picture and a second reference picture are located at a same temporal side with respect to the current picture, said direction index for said second set is equal to said direction index encoded for said first set and wherein in the case where said first and second reference pictures are located at different temporal sides with respect to the current picture, said direction index for said second set is equal to an opposite of said direction index encoded for said first set. ### Claim 10 (depends on 1) The method of claim 1, wherein encoding the second set comprises encoding a distance index for said second set, said distance index for said second set being representative of a differential distance with respect to a distance represented by a distance index encoded for said first set. ### Claim 11 (depends on 8) The method of claim 8, wherein the distance index for said first set being representative of a distance in a set of N distances, said distance index for said second set is representative of a distance in a subset of said set of N distances, N being an integer. ### Claim 12 (depends on 3) The method of claim 3, wherein obtaining the second set of merge mode with motion vector difference indices for the second reference picture comprises decoding a distance index for said second set. ### Claim 13 (depends on 3) The method of claim 3, wherein in the case where said first and second reference pictures are located at a same temporal side with respect to the current picture, said direction index for said second set is equal to said direction index decoded for said first set and wherein in the case where said first and second reference pictures are located at different temporal sides with respect to the current picture, said direction index for said second set is equal to an opposite of said direction index decoded for said first set. ### Claim 14 (depends on 3) The method of claim 3, wherein obtaining the second set of merge mode with motion vector difference indices for the second reference picture comprises decoding a distance index for said second set, said distance index for said second set being representative of a differential distance with respect to a distance represented by a distance index decoded for said first set. ### Claim 15 (depends on 12) The method of claim 12, wherein the distance index for said first set being representative of a distance in a set of N distances, said distance index for said second set is representative of a distance in a subset of said set of N distances, N being an integer. ### Claim 16 (depends on 2) The apparatus of claim 2, wherein encoding the second set comprises encoding a distance index for said second set. ### Claim 17 (depends on 2) The apparatus of claim 2, wherein in the case where said first reference picture and a second reference picture are located at a same temporal side with respect to the current picture, said direction index for said second set is equal to said direction index encoded for said first set and wherein in the case where said first and second reference pictures are located at different temporal sides with respect to the current picture, said direction index for said second set is equal to an opposite of said direction index encoded for said first set. ### Claim 18 (depends on 2) The apparatus of claim 2, wherein encoding the second set comprises encoding a distance index for said second set, said distance index for said second set being representative of a differential distance with respect to a distance represented by a distance index encoded for said first set. ### Claim 19 (depends on 16) The apparatus of claim 16, wherein the distance index for said first set being representative of a distance in a set of N distances, said distance index for said second set is representative of a distance in a subset of said set of N distances, N being an integer. ### Claim 20 (depends on 4) The apparatus of claim 4, wherein obtaining the second set of merge mode with motion vector difference indices for the second reference picture comprises decoding a distance index for said second set. ### Claim 21 (depends on 4) The apparatus of claim 4, wherein in the case where said first and second reference pictures are located at a same temporal side with respect to the current picture, said direction index for said second set is equal to said direction index decoded for said first set and wherein in the case where said first and second reference pictures are located at different temporal sides with respect to the current picture, said direction index for said second set is equal to an opposite of said direction index decoded for said first set. ### Claim 22 (depends on 4) The apparatus of claim 4, wherein obtaining the second set of merge mode with motion vector difference indices for the second reference picture comprises decoding a distance index for said second set, said distance index for said second set being representative of a differential distance with respect to a distance represented by a distance index decoded for said first set. ### Claim 23 (depends on 20) The apparatus of claim 20, wherein the distance index for said first set being representative of a distance in a set of N distances, said distance index for said second set is representative of a distance in a subset of said set of N distances, N being an integer.