# US 2021/0281865 A1 · Coding and decoding of video coding modes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0281865 A1
- Document ID: US20210281865A1
- Status: Published application
- Kind: A1
- Application number: 17/317,522
- Filed: 2021-05-11
- Published: 2021-09-09
- Earliest claimed: 2018-11-20
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Hongbin LIU; Li ZHANG; Kai ZHANG; Jizheng XU; Yue WANG
- Web page: https://patentgrep.com/patent/US20210281865A1

## CPC

- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/517: by encoding
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/52: by predictive encoding
- H04N 19/521: {for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors}
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for processing a video includes performing a conversion between a current block of visual media data and a corresponding coded representation of the visual media data, wherein the conversion of the current block includes determining whether a use of one or both of a bi-directional optical flow (BIO) technique or a decoder-side motion vector refinement (DMVR) technique to the current block is enabled or disabled, and wherein the determining the use of the BIO technique or the DMVR technique is based on a cost criterion associated with the current block.

## Claims

### Claim 1

A method of processing video data, comprising:
performing a determination, by a processor, that a flag which can be signaled at multiple levels indicates, at least in part, that one or both of a decoder-side motion vector refinement (DMVR) technique or a bi-directional optical flow (BIO) technique is to be enabled for a current block; and
performing a conversion between the current block and a bitstream, wherein the bitstream includes the flag indicating whether the one or both of the DMVR technique and/or the BIO technique is enabled.

### Claim 2 (depends on 1)

The method of claim 1, wherein the flag is signaled in the bitstream in response to detecting that an advanced motion vector prediction (AMVP) technique is enabled for the current block.

### Claim 3 (depends on 1)

The method of claim 1, wherein the flag is derived from one or both of spatial neighboring blocks or temporal neighboring blocks associated with the current block in response to detecting that a merge mode is enabled for the current block.

### Claim 4 (depends on 3)

The method of claim 3, wherein, the flag is inherited from a selected merging candidate if the selected merging candidate is a spatial merging candidate or a temporal merging candidate.

### Claim 5 (depends on 1)

The method of claim 1, wherein, a cost criterion associated with the current block is used to determine whether the one or both of the DMVR technique and/or the BIO technique is enabled, and the flag signaled in the bitstream is used to indicate whether such determination is correct or not.

### Claim 6 (depends on 5)

The method of claim 5, wherein the cost criterion associated with the current block is a sum of absolute difference (SAD) between two reference blocks of the current block, and wherein the determination that the one or both of the DMVR technique and/or the BIO technique is enabled applies when the cost criterion is greater than a threshold.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
upon determining at least one of:
that the current block is one of a uni-predicted block, a bi-predicted block associated with a pair of reference pictures both of which are either preceding or succeeding in a display order, a bi-predicted block associated with a pair of reference pictures with different picture order count (POC) distances from a current picture associated with the current block, an intra coded block, and a hybrid intra and inter predicted block,
that the current block is associated with at least one block of a picture same as a reference block,
that a dimension of the current block is smaller than a first threshold value,
that a dimension of the current block is greater than or equal to a second threshold value,
that a precision of motion information associated with the current block is an integer precision,
that a temporal layer associated with the picture containing the current block is beyond a third threshold value, and
that a quantization parameter associated with the current block is beyond a fourth threshold value,
skipping signaling of the flag in the bitstream.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
in response to determining that signaling of the flag in the bitstream is skipped, deriving a value of the flag as a Boolean true or false.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
upon determining that the flag is a Boolean true, enabling the one or both of the DMVR technique or the BIO technique.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
upon determining that the flag is a Boolean false, disabling the one or both of the DMVR technique or the BIO technique.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
upon determining that the flag is a Boolean true, the determination of the enabling or disabling one or both of the DMVR technique or the BIO technique based on at least one cost criterion is determined as correct.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
upon determining that the flag is a Boolean false, the determination of the enabling or disabling one or both of the DMVR technique or the BIO technique based on at least one cost criterion is determined as incorrect.

### Claim 13 (depends on 1)

The method of claim 1, wherein the flag is signaled in a slice header, a picture header, a tile header, a Video Parameter Set (VPS), a Sequence Parameter Set (SPS), or a Picture Parameter Set (PPS).

### Claim 14 (depends on 1)

The method of claim 1, wherein a first flag is signaled to indicate whether the DMVR technique is enabled or not, and a second flag is signaled to indicate whether the BIO technique is enabled or not.

### Claim 15 (depends on 7)

The method of claim 7, further comprising at least one of:
upon determining that the flag for the DMVR technique is a Boolean true, disabling the DMVR technique for a slice, a tile, a video, a sequence or a picture; and
upon determining that the flag for the BIO technique is a Boolean true, disabling the BIO technique for a slice, a tile, a video, a sequence or a picture.

### Claim 16 (depends on 7)

The method of claim 7, further comprising at least one of:
upon determining that the flag for the DMVR technique is a Boolean false, enabling the DMVR technique for a slice, a tile, a video, a sequence or a picture; and
upon determining that the flag for the BIO technique is a Boolean false, enabling the BIO technique for a slice, a tile, a video, a sequence or a picture.

### Claim 17 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the current video block into the bitstream.

### Claim 18 (depends on 1)

The method of claim 1, wherein the conversion includes decoding the current video block from the bitstream.

### Claim 19

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a determination, that a flag which can be signaled at multiple levels indicates, at least in part, that one or both of a decoder-side motion vector refinement (DMVR) technique or a bi-directional optical flow (BIO) technique is to be enabled for a current block; and
perform a conversion between the current block and a bitstream, wherein the bitstream includes the flag indicating whether the one or both of the DMVR technique and/or the BIO technique is enabled.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
performing a determination, that a flag which can be signaled at multiple levels indicates, at least in part, that one or both of a decoder-side motion vector refinement (DMVR) technique or a bi-directional optical flow (BIO) technique is to be enabled for a current block; and
generating the bitstream from the current block based on the determination, wherein the bitstream includes the flag indicating whether the one or both of the DMVR technique and/or the BIO technique is enabled.
