# US 11,909,986 B2 · Video decoding method and device therefor, and video encoding method and device therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,986 B2
- Document ID: US11909986B2
- Status: Granted
- Kind: B2
- Application number: 17/973,798
- Filed: 2022-10-26
- Published: 2023-02-23
- Granted: 2024-02-20
- Earliest claimed: 2016-07-14
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Elena Alshina; Alexander Alshin
- Web page: https://patentgrep.com/patent/US11909986B2

## CPC

- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is a video decoding method including: obtaining a first motion vector indicating a first reference block of a current block in a first reference picture and a second motion vector indicating a second reference block of the current block in a second reference picture; obtaining a parameter related to pixel group unit motion compensation of the current block, based on at least one of information of the parameter related to the pixel group unit motion compensation and a parameter related to an image including the current picture; generating a prediction block by performing, with respect to the current block, block unit motion compensation based on the first motion vector and the second motion vector and performing the pixel group unit motion compensation based on the parameter related to the pixel group unit motion compensation; and reconstructing the current block. Here, a pixel group may include at least one pixel.

## Claims

### Claim 1

A video decoding method comprising:
determining whether to perform optical flow based compensation by using at least one of a size of a current block, flag information related to whether to perform the optical flow based compensation, a picture order count (POC) difference, and whether the current block is bi-predicted;
if it is determined to perform the optical flow based compensation, obtaining a first displacement vector in a horizontal direction and a second displacement vector in a vertical direction for a pixel group;
obtaining a predicted pixel value of the current block based on a pixel value of a first reference block, a pixel value of a second reference block and a value obtained by using the first displacement vector and the second displacement vector for the pixel group; and
reconstructing the current block based on the predicted pixel value,
wherein:
the flag information is obtained from a bitstream,
the POC difference is a difference between a POC of a reference picture and a POC of a current picture, and
the pixel group is N×N, N being equal to or greater than 2.

### Claim 2

A video decoding apparatus comprising:
an inter predictor configured to:
determine whether to perform optical flow based compensation by using at least one of a size of a current block, flag information related to whether to perform the optical flow based compensation, a picture order count (POC) difference, and whether the current block is bi-predicted;
if it is determined to perform the optical flow based compensation, obtain a first displacement vector in a horizontal direction and a second displacement vector in a vertical direction for a pixel group; and
obtain a predicted pixel value of the current block based on a pixel value of a first reference block, a pixel value of a second reference block and a value obtained by using the first displacement vector and the second displacement vector for the pixel group, and
a decoder configured to reconstruct the current block based on the predicted pixel value,
wherein:
the flag information is obtained from a bitstream,
the POC difference is a difference between a POC of a reference picture and a POC of a current picture, and
the pixel group is N×N block, N being equal to or greater than 2.

### Claim 3

A video encoding method comprising:
determining whether to perform optical flow based compensation by using at least one of a size of a current block, flag information related to whether to perform the optical flow based compensation, a picture order count (POC) difference, and whether the current block is bi-predicted;
if it is determined to perform the optical flow based compensation, obtaining a first displacement vector in a horizontal direction and a second displacement vector in a vertical direction for a pixel group;
obtaining a predicted pixel value of the current block based on a pixel value of a first reference block, a pixel value of a second reference block and a value obtained by using the first displacement vector and the second displacement vector for the pixel group; and
encoding the current block based on the predicted pixel value,
wherein:
the flag information is included in a bitstream,
the POC difference is a difference between a POC of a reference picture and a POC of a current picture, and
the pixel group is N×N, N being equal to or greater than 2.

### Claim 4

A video encoding apparatus comprising:
an inter predictor configured to:
determine whether to perform optical flow based compensation by using at least one of a size of a current block, flag information related to whether to perform the optical flow based compensation, a picture order count (POC) difference, and whether the current block is bi-predicted;
if it is determined to perform the optical flow based compensation, obtain a first displacement vector in a horizontal direction and a second displacement vector in a vertical direction for a pixel group;
obtain a predicted pixel value of the current block based on a pixel value of a first reference block, a pixel value of a second reference block and a value obtained by using the first displacement vector and the second displacement vector for the pixel group; and
encode the current block based on the predicted pixel value, and
a generator configured to generate a bitstream comprising the encoding results,
wherein:
the flag information is included in the bitstream,
the POC difference is a difference between a POC of a reference picture and a POC of a current picture, and
the pixel group is N×N, N being equal to or greater than 2.

### Claim 5

A non-transitory computer-readable medium for recording a bitstream, the bitstream comprising:
encoding results of a current block,
wherein, the encoding results of the current block is obtained by:
determining whether to perform optical flow based compensation by using at least one of a size of a current block, flag information related to whether to perform the optical flow based compensation, a picture order count (POC) difference, and whether the current block is bi-predicted;
if it is determined to perform the optical flow based compensation, obtaining a first displacement vector in a horizontal direction and a second displacement vector in a vertical direction for a pixel group;
obtaining a predicted pixel value of the current block based on a pixel value of a first reference block, a pixel value of a second reference block and a value obtained by using the first displacement vector and the second displacement vector for the pixel group; and
encoding the current block based on the predicted pixel value,
wherein:
the flag information is included in the bitstream,
the POC difference is a difference between a POC of a reference picture and a POC of a current picture, and
the pixel group is N×N, N being equal to or greater than 2.