# US 12,114,008 B2 · Method and apparatus for inter-prediction of pictures with different resolutions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,114,008 B2
- Document ID: US12114008B2
- Status: Granted
- Kind: B2
- Application number: 17/765,391
- Filed: 2020-09-29
- Published: 2022-12-29
- Granted: 2024-10-08
- Earliest claimed: 2019-09-30
- Assignees: Hyundai Motor Company; Kia Corporation; Kwangwoon University Industry-Academic Collaboration Foundation
- Applicants: Hyundai Motor Company; Kia Corporation; Kwangwoon University Industry-Academic Collaboration Foundation
- Inventors: Dong Gyu Sim; Jong Seok Lee; Seung Wook Park; Wha Pyeong Lim
- Web page: https://patentgrep.com/patent/US12114008B2

## CPC

- H04N 19/53: Multi-resolution motion estimation; Hierarchical motion estimation
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/513: Processing of motion vectors
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video decoding apparatus is provided for decoding a sequence of pictures, some of which have different resolutions. The apparatus decodes, from a high-level syntax structure of the sequence, a first syntax element for specifying a reference size of pictures referring to the high-level syntax structure and a second syntax element for specifying a picture size scaled from the reference size of the picture referring to the high-level syntax structure. The apparatus predicts a current block, by modifying a sample position in a reference picture indicated by a motion vector of the current block based on the first and second syntax elements.

## Claims

### Claim 1

A method for decoding a sequence of pictures, some of which have different resolutions, the method comprising:
decoding, from a high-level syntax structure of a bitstream, a first syntax element for specifying a reference size of pictures referring to the high-level syntax structure and a second syntax element for specifying a picture size scaled from the reference size of the pictures referring to the high-level syntax structure;
deriving, based on the first syntax element and the second syntax element, at least one offset factor and at least one scale factor representing a scale difference between a current picture including a current block to be decoded and a reference picture referred to by the current block, wherein the at least one scale factor and the at least one offset factor are used to modify a sample position indicated by a motion vector of the current block within the reference picture; and
generating a prediction bock of the current block from the reference picture, by using the motion vector of the current block, the at least one scale factor, and the at least one offset factor,
wherein the at least one scale factor includes a horizontal scale factor and a vertical scale factor that are respectively applied to horizontal and vertical components of the motion vector of the current block, and
wherein the at least one offset factor includes a horizontal offset factor and a vertical offset factor that are respectively applied to horizontal and vertical components of the motion vector of the current block.

### Claim 2 (depends on 1)

The method of claim 1, wherein the high-level syntax structure is a picture parameter set respectively defined for picture groups, each of the picture groups comprising one or more pictures among the pictures included in the sequence, and wherein the picture parameter set contains parameters commonly referred to by the pictures within a corresponding picture group.

### Claim 3 (depends on 1)

The method of claim 1, wherein the generating of a prediction block of the current block comprises:
generating a modified motion vector by applying the at least one scale factor and the at least one offset factor to the motion vector of the current block; and
generating the prediction block by using reconstructed samples at a position indicated by the modified motion vector within the reference picture.

### Claim 4 (depends on 1)

The method of claim 1, wherein the prediction block is generated by filtering the reference picture, and a filter used for the filtering is adaptively selected from among a plurality of filters according to the at least one scale factor.

### Claim 5 (depends on 4)

The method of claim 4, wherein the filtering comprises horizontal filtering and vertical filtering,
wherein a filter for the horizontal filtering is adaptively determined according to the horizontal scale factor, and a filter for the vertical filtering is adaptively determined according to the vertical scale factor.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second syntax element is defined by offset values from left, upper, right, and lower boundaries of a picture having the reference size.

### Claim 7

A method for encoding a sequence of pictures, some of which have different resolutions, the method comprising:
encoding, into a high-level syntax structure of a bitstream, a first syntax element for specifying a reference size of pictures referring to the high-level syntax structure and a second syntax element for specifying a picture size scaled from the reference size of the pictures referring to the high-level syntax structure,
wherein the first syntax element and the second syntax element are encoded for use in deriving at least one offset factor and at least one scale factor representing a scale difference between a current picture including a current block to be decoded and a reference picture referred to by the current block,
wherein the at least one scale factor and the at least one offset factor are used to modify a sample position indicated by a motion vector of the current block within the reference picture; and
generating a prediction bock of the current block from the reference picture, by using the motion vector of the current block, the at least one scale factor, and the at least one offset factor,
wherein the at least one scale factor includes a horizontal scale factor and a vertical scale factor that are respectively applied to horizontal and vertical components of the motion vector of the current block, and
wherein the at least one offset factor includes a horizontal offset factor and a vertical offset factor that are respectively applied to horizontal and vertical components of the motion vector of the current block.

### Claim 8

A method for transmitting a bitstream containing encoded video data, the encoding a sequence of pictures, some of which have different resolutions, the method comprising:
generating the bitstream by encoding a sequence of pictures some of which have different resolutions; and
transmitting the bitstream to a video decoding apparatus,
wherein generating the bitstream comprises:
encoding, into a high-level syntax structure of the bitstream, a first syntax element for specifying a reference size of pictures referring to the high-level syntax structure and a second syntax element for specifying a picture size scaled from the reference size of the pictures referring to the high-level syntax structure,
wherein the first syntax element and the second syntax element are encoded for use in deriving at least one offset factor and at least one scale factor representing a scale difference between a current picture including a current block to be decoded and a reference picture referred to by the current block,
wherein the at least one scale factor and the at least one offset factor are used to modify a sample position indicated by a motion vector of the current block within the reference picture;
generating a prediction bock of the current block from the reference picture, by using the motion vector of the current block, the at least one scale factor, and the at least one offset factor; and
encoding residual data of the current block based on the prediction block,
wherein the at least one scale factor includes a horizontal scale factor and a vertical scale factor that are respectively applied to horizontal and vertical components of the motion vector of the current block, and
wherein the at least one offset factor includes a horizontal offset factor and a vertical offset factor that are respectively applied to horizontal and vertical components of the motion vector of the current block.