# US 11,910,094 B2 · Image data encoding/decoding method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,910,094 B2
- Document ID: US11910094B2
- Status: Granted
- Kind: B2
- Application number: 18/447,088
- Filed: 2023-08-09
- Published: 2023-12-21
- Granted: 2024-02-20
- Earliest claimed: 2016-10-04
- Assignees: B1 Institute of Image Technology, Inc.
- Applicants: B1 Institute of Image Technology, Inc.
- Inventors: Ki Baek Kim
- Web page: https://patentgrep.com/patent/US11910094B2

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 3/12: Panospheric to cylindrical image transformations
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/129: Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/513: Processing of motion vectors
- H04N 19/52: by predictive encoding
- H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders
- H04N 19/563: Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/625: using discrete cosine transform [DCT]
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

## Claims

### Claim 1

A method of decoding a current image with a decoding apparatus, comprising:
receiving a bitstream including the current image;
dividing, based on coding information from the bitstream, a coding block in the current image to obtain one or more sub-blocks,
wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain one or more sub-blocks, a second flag indicating whether to divide the coding block asymmetrically, or a third flag indicating whether a division direction for the coding block is a horizontal direction or a vertical direction, and
wherein, in case the coding block is divided asymmetrically, a first sub-block having a ¼ size of the coding block is obtained, the first sub-block belonging to the one or more sub-blocks;
obtaining inverse-quantized coefficients of the first sub-block by performing inverse-quantization on the first sub-block;
determining a transform method among a plurality of transform methods based on information for transform included in the bitstream:
reconstructing a residual signal of the first sub-block by performing inverse-transform on the inverse-quantized coefficients based on the determined transform method; and
reconstructing the coding block based on the residual signal and a prediction signal corresponding to the residual signal,
wherein the prediction signal is generated by obtaining prediction information for the coding block from the bitstream, determining a prediction method for the coding block based on the prediction information, and performing prediction for the coding block based on the determined prediction method, and
wherein obtaining the inverse-quantized coefficients of the first sub-block comprises:
selecting one of a plurality of weight set candidates pre-defined in the decoding apparatus; and
performing the inverse-quantization on the first sub-block based on the selected weight set candidate.

### Claim 2 (depends on 1)

The method of claim 1, wherein each of the weight set candidates includes a plurality of weight components, and
wherein at least one of the weight components belonging to the one of the weight set candidates is different from the weight components belonging to the other of the weight set candidates.

### Claim 3 (depends on 1)

The method of claim 1, wherein a transform type for the inverse-transform of the inverse-quantized coefficients is determined by considering whether or not a size of the first sub-block is greater than a threshold size pre-defined in the decoding apparatus.

### Claim 4 (depends on 3)

The method of claim 3, wherein a number of transform types available for the first sub-block when the size of the first sub-block is greater than the threshold size is different from the number of the transform types available for the first sub-block when the size of the first sub-block is less than or equal to the threshold size.

### Claim 5 (depends on 4)

The method of claim 4, wherein a transform type for the inverse-transform of the quantized coefficients is determined by further considering at least one of the first flag, the second flag, or the third flag.

### Claim 6

A method of encoding a current image with an encoding apparatus, comprising:
dividing a coding block in the current image to obtain one or more sub-blocks;
determining a transform method among a plurality of transform methods, the determined transform method being encoded based on information for transform into a bitstream:
obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block based on the determined transform method, the first sub-block belonging to the one or more sub-blocks;
obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and
generating the bitstream by encoding the quantized transform coefficients of the first sub-block,
wherein the residual signal is obtained based on a prediction signal corresponding to the residual signal,
wherein the prediction signal is generated by determining a prediction method for the coding block, and performing prediction for the coding block based on the determined prediction method,
wherein the determined prediction method is encoded into the bitstream using prediction information,
wherein coding information for dividing the coding block is encoded into the bitstream,
wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks, a second flag indicating whether to divide the coding block asymmetrically, or a third flag indicating whether a division direction for the coding block is a horizontal direction or a vertical direction,
wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and
wherein obtaining the quantized transform coefficients of the first sub-block comprises:
selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and
performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.

### Claim 7

A non-transitory computer-readable medium for storing data associated with an image signal, comprising:
a data stream encoded by an encoding method,
wherein the encoding method comprises:
dividing a coding block in the current image to obtain one or more sub-blocks;
determining a transform method among a plurality of transform methods, the determined transform method being encoded based on information for transform into a bitstream:
obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block based on the determined transform method, the first sub-block belonging to the one or more sub-blocks;
obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and
generating the bitstream by encoding the quantized transform coefficients of the first sub-block,
wherein the residual signal is obtained based on a prediction signal corresponding to the residual signal,
wherein the prediction signal is generated by determining a prediction method for the coding block, and performing prediction for the coding block based on the determined prediction method,
wherein the determined prediction method is encoded into the bitstream using prediction information,
wherein coding information for dividing the coding block is encoded into the bitstream,
wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks, a second flag indicating whether to divide the coding block asymmetrically, or a third flag indicating whether a division direction for the coding block is a horizontal direction or a vertical direction,
wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and
wherein obtaining the quantized transform coefficients of the first sub-block comprises:
selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and
performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.

### Claim 8

A method for transmitting data associated with an image signal, the method comprising:
obtaining a data stream encoded by an encoding method; and
transmitting the data stream,
wherein the encoding method comprises:
dividing a coding block in the current image to obtain one or more sub-blocks;
determining a transform method among a plurality of transform methods, the determined transform method being encoded based on information for transform into a bitstream;
obtaining transform coefficients of a first sub-block by performing transform on a residual signal of the first sub-block based on the determined transform method, the first sub-block belonging to the one or more sub-blocks;
obtaining quantized transform coefficients of the first sub-block by performing quantization on the transform coefficients of the first sub-block; and
generating the bitstream by encoding the quantized transform coefficients of the first sub-block,
wherein the residual signal is obtained based on a prediction signal corresponding to the residual signal,
wherein the prediction signal is generated by determining a prediction method for the coding block, and performing prediction for the coding block based on the determined prediction method,
wherein the determined prediction method is encoded into the bitstream using prediction information,
wherein coding information for dividing the coding block is encoded into the bitstream,
wherein the coding information includes at least one of a first flag indicating whether to divide the coding block to obtain the one or more sub-blocks, a second flag indicating whether to divide the coding block asymmetrically, or a third flag indicating whether a division direction for the coding block is a horizontal direction or a vertical direction,
wherein, in case the coding block is divided asymmetrically, the first sub-block having a ¼ size of the coding block is obtained, and
wherein obtaining the quantized transform coefficients of the first sub-block comprises:
selecting one of a plurality of weight set candidates pre-defined in the encoding apparatus; and
performing the quantization on the transform coefficients of the first sub-block based on the selected weight set candidate.