# US 2022/0191456 A1 · Image data encoding/decoding method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0191456 A1
- Document ID: US20220191456A1
- Status: Published application
- Kind: A1
- Application number: 17/687,963
- Filed: 2022-03-07
- Published: 2022-06-16
- Earliest claimed: 2016-10-04
- Assignees: B1 Institute of Image Technology, Inc.
- Applicants: B1 Institute of Image Technology, Inc.
- Inventors: Ki Baek KIM
- Web page: https://patentgrep.com/patent/US20220191456A1

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/129: Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/625: using discrete cosine transform [DCT]
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 19/61: in combination with predictive coding
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

## Claims

### Claim 1

A method of decoding a 360-degree image, the method comprising:
receiving a bitstream in which the 360-degree image is encoded, the bitstream including data of an extended 2-dimensional image, the extended 2-dimensional image including a 2-dimensional image and a predetermined extension region, and the 2-dimensional image being projected from an image with a 3-dimensional projection structure and including one or more faces;
generating a predicted image by performing prediction based on information on the prediction included in the bitstream; and
reconstructing the extended 2-dimensional image based on the predicted image and a residual image,
wherein a size of the extension region is determined based on size information obtained from the bitstream,
wherein whether the extended 2-dimensional image includes the extension region is determined based on information included in the bitstream,
wherein the residual image is obtained by decoding residual information included in the bitstream,
wherein the predicted image is added to the residual image to reconstruct the extended 2-dimensional image, and
wherein the predicted image is generated by performing inter prediction or intra prediction.

### Claim 2 (depends on 1)

The method of claim 1, wherein the size information comprises width information indicating a width of the extension region.

### Claim 3 (depends on 1)

The method of claim 1, wherein sample values of the extension region are determined differently according to a padding method selected from a plurality of padding methods.

### Claim 4 (depends on 3)

The method of claim 3, wherein the padding method is selected from the plurality of padding methods based on selection information obtained from the bitstream.

### Claim 5 (depends on 3)

The method of claim 3, wherein the plurality of padding methods comprises a padding method which horizontally copies the sample values of boundary samples of the face to the sample values of the extension region.

### Claim 6 (depends on 3)

The method of claim 3, wherein the plurality of padding methods comprises a padding method where an image characteristic of the extension region changes from the image characteristic of the face.

### Claim 7 (depends on 3)

The method of claim 3, wherein the plurality of padding methods comprises a padding method where an image characteristic of the extension region is the same as the image characteristic of the face.

### Claim 8 (depends on 3)

The method of claim 3, wherein the padding method is independently selected for each of the one or more faces.

### Claim 9 (depends on 1)

The method of claim 1, wherein the 3-dimensional projection structure is at least one among a first 3-dimensional projection structure and a second 3-dimensional projection structure.

### Claim 10 (depends on 9)

The method of claim 9, wherein, in case of the first 3-dimensional projection structure, the size information on the size of the extension region comprises first width information for a left extension region on a left side of the 2-dimensional image and second width information for a right extension region on a right side of the 2-dimensional image.

### Claim 11 (depends on 9)

The method of claim 9, wherein, in case of the second 3-dimensional projection structure, the size information on the size of the extension region comprises first width information for a left extension region on a left side of the 2-dimensional image, second width information for a right extension region on a right side of the 2-dimensional image, first height information for a top extension region above the 2-dimensional image and second height information for a bottom extension region below the 2-dimensional image.

### Claim 12 (depends on 1)

The method of claim 1, wherein the bitstream comprises information on the number the faces.

### Claim 13

A method of encoding a 360-degree image, the method comprising:
obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;
obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region;
generating a predicted image by performing prediction, information on the prediction being encoded into the bitstream; and
encoding data of the extended 2-dimensional image into the bitstream based on the predicted image and a residual image,
wherein size information on a size of the extension region is encoded into the bitstream,
wherein information indicating whether the extended 2-dimensional image includes the extension region is encoded into the bitstream,
wherein residual information is included in the bitstream by encoding the residual image,
wherein the residual image is obtained based on the extended 2-dimensional image and the predicted image, and
wherein the predicted image is generated by performing inter prediction or intra prediction.

### Claim 14

A non-transitory computer-readable recording medium storing a bitstream that is generated by a method for encoding a 360-degree image, the method comprising:
obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;
obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region;
generating a predicted image by performing prediction, information on the prediction being encoded into the bitstream; and
encoding data of the extended 2-dimensional image into the bitstream based on the predicted image and a residual image,
wherein size information on a size of the extension region is encoded into the bitstream,
wherein information indicating whether the extended 2-dimensional image includes the extension region is encoded into the bitstream,
wherein residual information is included in the bitstream by encoding the residual image,
wherein the residual image is obtained based on the extended 2-dimensional image and the predicted image, and
wherein the predicted image is generated by performing inter prediction or intra prediction.

### Claim 15

A method of transmitting a bitstream, comprising:
obtaining a 2-dimensional image projected from an image with a 3-dimensional projection structure and including at least one face;
obtaining an extended 2-dimensional image including the 2-dimensional image and a predetermined extension region;
generating a predicted image by performing prediction, information on the prediction being encoded into the bitstream;
encoding data of the extended 2-dimensional image into the bitstream based on the predicted image and a residual image; and
transmitting the bitstream to an image decoding apparatus,
wherein size information on a size of the extension region is encoded into the bitstream,
wherein information indicating whether the extended 2-dimensional image includes the extension region is encoded into the bitstream,
wherein residual information is included in the bitstream by encoding the residual image,
wherein the residual image is obtained based on the extended 2-dimensional image and the predicted image, and
wherein the predicted image is generated by performing inter prediction or intra prediction.
