# US 2021/0243439 A1 · Image encoding device and method and image decoding device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243439 A1
- Document ID: US20210243439A1
- Status: Published application
- Kind: A1
- Application number: 17/237,661
- Filed: 2021-04-22
- Published: 2021-08-05
- Earliest claimed: 2013-03-21
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Kazushi SATO
- Web page: https://patentgrep.com/patent/US20210243439A1

## CPC

- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/187: the unit being a scalable video layer
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to an image encoding device and method and an image decoding device and method, which are capable of suppressing an increase in encoding or decoding workload. A current layer of image data including a plurality of layers is encoded and/or decoded with reference to encoding-related information of some areas, of another layer encoded for each of a plurality of certain areas obtained by dividing a picture, according to control of control information used to control the certain area in which the encoding-related information of the other layer is referred to regarding the current layer of the image data. The present disclosure can be applied to image processing devices such as an image encoding device for performing scalable coding on image data and an image decoding device for decoding an encoded data obtained by performing scalable coding on image data

## Claims

### Claim 1

An image encoding device for encoding image data including a base layer and at least one enhancement layer, the image encoding device comprising:
a generation section configured to generate control information designating, for a tile of an enhancement layer, a permitted reference area in the base layer, wherein each of the base layer, the at least one enhancement layer, and the permitted reference area comprise one or more tiles, wherein for each of the base layer and the at least one enhancement layer a picture of the image data is divided into the tiles which are independently decodable;
an encoding section configured to encode the tile of the enhancement layer with reference to encoding-related information of the permitted reference area in the base layer according to the control information generated by the generation section; and
a transmission section configured to transmit encoded data of the image data generated by the encoding section and the control information generated by the generation section,
wherein the generation section, the encoding section, and the transmission section are each implemented via at least one processor.

### Claim 2 (depends on 1)

The image encoding device according to claim 1,
wherein the control information designates the tile of the permitted reference area using an identification number allocated in a raster scan order.

### Claim 3 (depends on 1)

The image encoding device according to claim 1,
wherein the control information designates the tile of the permitted reference area using information indicating a position of the tile in a picture.

### Claim 4 (depends on 1)

The image encoding device according to claim 1,
wherein the generation section is further configured to generate information indicating whether or not a tile division of the enhancement layer is similar to a tile division of the base layer.

### Claim 5 (depends on 1)

The image encoding device according to claim 1,
wherein the generation section is further configured to generate control information determination information serving as information used to control whether or not control information is transmitted, and generate the control information based on the control information determination information.

### Claim 6 (depends on 1)

The image encoding device according to claim 1,
wherein the transmission section is further configured to transmit information indicating whether or not to control a tile in which the encoding-related information is referred to.

### Claim 7 (depends on 1)

The image encoding device according to claim 1,
wherein the encoding-related information includes information used for generation of a prediction image used in encoding of the image data.

### Claim 8 (depends on 7)

The image encoding device according to claim 7,
wherein the information used for the generation of the prediction image includes information used for texture prediction of the image data and information used for syntax prediction of the image data, and
the control information includes information used to independently control a tile in which the information used for the texture prediction is referred to and a tile in which the information used for the syntax prediction is referred to.

### Claim 9 (depends on 1)

The image encoding device according to claim 1,
wherein the control information designates a tile in which reference to the encoding-related information of the base layer is permitted.

### Claim 10 (depends on 1)

The image encoding device according to claim 1,
wherein the control information designates a tile in which reference to the encoding-related information of the base layer is prohibited.

### Claim 11 (depends on 1)

The image encoding device according to claim 1,
wherein the generation section is further configured to generate the control information for each certain tile of a plurality of certain tiles obtained by dividing the picture of the enhancement layer of the image data, and
the encoding section is further configured to encode the enhancement layer of the image data with reference to encoding-related information of some tiles of the base layer for each of the tiles according to control of the control information of each tile generated by the generation section.

### Claim 12

An image encoding method for encoding image data including a base layer and at least one enhancement layer, the method comprising:
generating control designating, for a tile of an enhancement layer, a permitted reference area in the base layer, wherein each of the base layer, the at least one enhancement layer, and the permitted reference area comprise one or more tiles, wherein for each of the base layer and the at least one enhancement layer a picture of the image data is divided into the tiles which are independently decodable;
encoding the tile of the enhancement layer with reference to encoding-related information of the permitted reference area in the base layer according to the control information; and
transmitting encoded data of the image data and the control information.

### Claim 13

An image decoding device comprising:
a reception section configured to
receive encoded data of a tile of an enhancement layer of image data, the image data including a base layer and at least one enhancement layer, wherein each of the base layer and the at least one enhancement layer comprises one or more tiles, wherein for each of the base layer and the at least one enhancement layer a picture of the image data is divided into the tiles which are independently decodable, and
receive control information designating, for the tile of the enhancement layer, a permitted reference area in the base layer, wherein reference to encoding-related information for the permitted reference area for decoding of the encoded data of the tile of the enhancement layer is permitted, wherein the permitted reference area identifies a set of tiles; and
a decoding section configured to configured to decode the encoded data with reference to the permitted reference area according to control of the control information received by the reception section,
wherein the reception section and the decoding section are each implemented via at least one processor.

### Claim 14 (depends on 13)

The image decoding device according to claim 13,
wherein the control information designates the set of tiles using an identification number allocated in a raster scan order, information indicating positions of the tile in vertical and horizontal directions in a picture, or information indicating a data position of the tile in the encoded data.

### Claim 15 (depends on 13)

The image decoding device according to claim 13,
wherein the reception section is further configured to receive information indicating whether or not to control a tile in which the encoding-related information is referred to.

### Claim 16 (depends on 13)

The image decoding device according to claim 13,
wherein the encoding-related information includes information used for generation of a prediction image used in decoding of the encoded data.

### Claim 17 (depends on 16)

The image decoding device according to claim 16,
wherein the information used for the generation of the prediction image includes information used for texture prediction of the image data and information used for syntax prediction of the image data, and
the control information includes information used to independently control a tile in which the information used for the texture prediction is referred to and a tile in which the information used for the syntax prediction is referred to.

### Claim 18 (depends on 13)

The image decoding device according to claim 13,
wherein the reception section is further configured to receive the encoded data encoded for each of the tiles obtained by dividing the picture of the enhancement layer of the image data and the control information of each of the tiles, and
the decoding section is further configured to decode the encoded data received by the reception section with reference to the encoding-related information of some tiles of the base layer for each of the tiles according to control of the control information of each tile.

### Claim 19 (depends on 13)

The image decoding device according to claim 13,
wherein the reception section is further configured to receive information indicating whether it is possible to detect a tile division of the enhancement layer with reference to a tile division of the base layer.

### Claim 20 (depends on 13)

The image decoding device according to claim 13,
wherein the control information designates a tile in which reference to the encoding-related information of the base layer is permitted.

### Claim 21 (depends on 13)

The image decoding device according to claim 13,
wherein the control information designates a tile in which reference to the encoding-related information of the base layer is prohibited.

### Claim 22 (depends on 13)

The image decoding device according to claim 13,
wherein the control information designates a tile in which the encoding-related information of the base layer is referred to.

### Claim 23 (depends on 13)

The image decoding device according to claim 13,
wherein the reception section is further configured to receive control information determination information serving as information used to control whether or not control information is transmitted, and receive the control information based on the control information determination information.

### Claim 24

An image decoding method comprising:
receiving encoded data of a tile of an enhancement layer of image data, the image data including a base layer and at least one enhancement layer, wherein each of the base layer and the at least one enhancement layer comprises one or more tiles, wherein for each of the base layer and the at least one enhancement layer a picture of the image data is divided into the tiles which are independently decodable;
receiving control information designating, for the tile of the enhancement layer, a permitted reference area in the base layer, wherein reference to encoding-related information for the permitted reference area for decoding of the encoded data of the tile of the enhancement layer is permitted, wherein the permitted reference area identifies a set of tiles; and
decoding the encoded data with reference to the permitted reference area according to control of the control information.
