# US 12,010,321 B2 · Affine based merge with MVD > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,321 B2 - Document ID: US12010321B2 - Status: Granted - Kind: B2 - Application number: 17/372,968 - Filed: 2021-07-12 - Published: 2021-11-11 - Granted: 2024-06-11 - Earliest claimed: 2019-01-10 - Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Inventors: Kai Zhang; Li Zhang; Hongbin Liu; Jizheng Xu; Yue Wang - Web page: https://patentgrep.com/patent/US12010321B2 ## CPC - H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/52: by predictive encoding - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed and systems, methods and devices for video processing. An exemplary method for video processing includes: determining for a current video block, an indication which indicates that an affine merge with motion vector difference (MMVD) mode is applied to the current video block; performing a conversion between the current video block and a bitstream representation of a current video block based on the indication, the indication being activated based on the usage of at least one merge list for the current video block. ## Claims ### Claim 1 A method for video processing, comprising: determining that an affine mode is enabled for a first block of a video; in response to the affine mode being enabled for the first block, determining whether a first ultimate motion vector expression mode related with the affine mode is applied to the first block; in response to the first ultimate motion vector expression mode related with the affine mode being applied to the first block, determining a first ultimate motion vector expression mode information for the first block, wherein the first ultimate motion vector expression mode information comprises a first distance index and a first direction information, the first distance index indicates an offset of a refined motion information respective to an original motion information of the first block and the first direction information indicates a direction of the offset; and performing a conversion between the first block and a bitstream of the video using the first ultimate motion vector expression mode information, wherein a second ultimate motion vector expression mode related with a non-affine mode is applied to a second block coded with the non-affine mode, wherein the second ultimate motion vector expression mode corresponds to a second ultimate motion vector expression mode information, and wherein the second ultimate motion vector expression mode information comprises a second distance index indicating an offset of a refined motion information respective to an original motion information of the second block and a second direction information indicating a direction of the offset. ### Claim 2 (depends on 1) The method of claim 1, wherein the non-affine mode is one of a regular merge mode, a sub-block based temporal motion vector prediction mode, a mode in which the first block comprises at least two partitions, at least one of which is non-square and non-rectangular. ### Claim 3 (depends on 1) The method of claim 1, wherein the offset corresponding to the first block and the offset corresponding to the second block are determined based on a same mapping between distances and offsets. ### Claim 4 (depends on 1) The method of claim 1, wherein the first direction information and the second direction information are coded with a same binarization method. ### Claim 5 (depends on 1) The method of claim 1, wherein whether the second ultimate motion vector expression mode related with the non-affine mode is enabled based on whether the non-affine mode is enabled. ### Claim 6 (depends on 1) The method of claim 1, wherein the first ultimate motion vector expression mode information comprises a first predefined information and the second ultimate motion vector expression mode information comprises a second predefined information, wherein the first predefined information and the second predefined information are respectively based on the first ultimate motion vector expression mode and the second ultimate motion vector expression mode. ### Claim 7 (depends on 1) The method of claim 1, wherein the conversion includes encoding the first block into the bitstream. ### Claim 8 (depends on 1) The method of claim 1, wherein the conversion includes decoding the first block from the bitstream. ### Claim 9 An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to: determine that an affine mode is enabled for a first block of a video; in response to the affine mode being enabled for the first block, determine whether a first ultimate motion vector expression mode related with the affine mode is applied to the first block; in response to the first ultimate motion vector expression mode related with the affine mode being applied to the first block, determine a first ultimate motion vector expression mode information for the first block, wherein the first ultimate motion vector expression mode information comprises a first distance index and a first direction information, the first distance index indicates an offset of a refined motion information respective to an original motion information of the first block and the first direction information indicates a direction of the offset; and perform a conversion between the first block and a bitstream of the video using the first ultimate motion vector expression mode information, wherein a second ultimate motion vector expression mode related with a non-affine mode is applied to a second block coded with the non-affine mode, wherein the second ultimate motion vector expression mode corresponds to a second ultimate motion vector expression mode information, wherein the second ultimate motion vector expression mode information comprises a second distance index indicating an offset of a refined motion information respective to an original motion information of the second block and a second direction information indicating a direction of the offset. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein the non-affine mode is one of a regular merge mode, a sub-block based temporal motion vector prediction mode, a mode in which the first block comprises at least two partitions, at least one of which is non-square and non-rectangular. ### Claim 11 (depends on 9) The apparatus of claim 9, wherein the offset corresponding to the first block and the offset corresponding to the second block are determined based on a same mapping between distances and offsets. ### Claim 12 (depends on 9) The apparatus of claim 9, wherein the first direction information and the second direction information are coded with a same binarization method. ### Claim 13 (depends on 9) The apparatus of claim 9, wherein whether the second ultimate motion vector expression mode related with the non-affine mode is enabled based on whether the non-affine mode is enabled. ### Claim 14 (depends on 9) The apparatus of claim 9, wherein the first ultimate motion vector expression mode information comprises a first predefined information and the second ultimate motion vector expression mode information comprises a second predefined information, wherein the first predefined information and the second predefined information are respectively based on the first ultimate motion vector expression mode and the second ultimate motion vector expression mode. ### Claim 15 (depends on 9) The apparatus of claim 9, wherein the conversion includes encoding the first block into the bitstream. ### Claim 16 (depends on 9) The apparatus of claim 9, wherein the conversion includes decoding the first block from the bitstream. ### Claim 17 A non-transitory computer-readable storage medium storing instructions that cause a processor to: determine that an affine mode is enabled for a first block of a video; in response to the affine mode being enabled for the first block, determine whether a first ultimate motion vector expression mode related with the affine mode is applied to the first block; in response to the first ultimate motion vector expression mode related with the affine mode being applied to the first block, determine a first ultimate motion vector expression mode information for the first block, wherein the first ultimate motion vector expression mode information comprises a first distance index and a first direction information, the first distance index indicates an offset of a refined motion information respective to an original motion information of the first block and the first direction information indicates a direction of the offset; and perform a conversion between the first block and a bitstream of the video using the first ultimate motion vector expression mode information; wherein a second ultimate motion vector expression mode related with a non-affine mode is applied to a second block coded with the non-affine mode, wherein the second ultimate motion vector expression mode corresponds to a second ultimate motion vector expression mode information, wherein the second ultimate motion vector expression mode information comprises a second distance index indicating an offset of a refined motion information respective to an original motion information of the second block and a second direction information indicating a direction of the offset. ### Claim 18 A method for storing a bitstream of a video, comprising: determining that an affine mode is enabled for a first block of the video; in response to the affine mode being enabled for the first block, determining whether a first ultimate motion vector expression mode related with the affine mode is applied to the first block; in response to the first ultimate motion vector expression mode related with the affine mode being applied to the first block, determining a first ultimate motion vector expression mode information for the first block, wherein the first ultimate motion vector expression mode information comprises a first distance index and a first direction information, the first distance index indicates an offset of a refined motion information respective to an original motion information of the first block and the first direction information indicates a direction of the offset; generating the bitstream using the first ultimate motion vector expression mode information; and storing the bitstream in a non-transitory computer-readable recording medium, wherein a second ultimate motion vector expression mode related with a non-affine mode is applied to a second block coded with the non-affine mode, wherein the second ultimate motion vector expression mode corresponds to a second ultimate motion vector expression mode information, wherein the second ultimate motion vector expression mode information comprises a second distance index indicating an offset of a refined motion information respective to an original motion information of the second block and a second direction information indicating a direction of the offset.