# US 2018/0027249 A1 · Image decoding apparatus, image decoding method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027249 A1
- Document ID: US20180027249A1
- Status: Published application
- Kind: A1
- Application number: 15/541,330
- Filed: 2015-12-22
- Published: 2018-01-25
- Earliest claimed: 2015-01-07
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Mitsuru Maeda; Koji Okawa
- Web page: https://patentgrep.com/patent/US20180027249A1

## CPC

- H04N 19/31: in the temporal domain
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/146: Data rate or code amount at the encoder output
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/162: User input
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/187: the unit being a scalable video layer
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image decoding apparatus, the image decoding apparatus decoding encoded data obtained by performing hierarchical coding on a moving image including one or more images using a plurality of temporal layers, includes a first acquisition unit configured to acquire information regarding frame rates of the moving image corresponding to the plurality of temporal layers used in the hierarchical coding, a second acquisition unit configured to acquire information regarding the size of a region of interest of the one or more images, a determination unit configured to determine a frame rate to be used in a case where the region of interest is displayed, in accordance with the information regarding the frame rates corresponding to the respective temporal layers, and the information regarding the size of the region of interest, and a decoding unit configured to decode the region of interest at the determined frame rate.

## Claims

### Claim 1 (depends on 9)

The image decoding apparatus according to claim 9,
wherein the encoded data decoded by the image decoding apparatus is encoded data obtained by performing hierarchical coding on a moving image including one or more images using a plurality of temporal layers, the image decoding apparatus further comprising:
a frame rates information acquisition unit configured to acquire information regarding frame rates of the moving image corresponding to the plurality of temporal layers used in the hierarchical coding;
wherein, the determination unit is configured to determine the frame rate for the region of interest in accordance with the information regarding the frame rates acquired by the frame rates information acquisition unit and corresponding to the respective temporal layers, and the information regarding the size of the region of interest acquired by the size acquisition unit.

### Claim 2 (depends on 9)

The image decoding apparatus according to claim 9, wherein the size acquisition unit acquires the number of tiles included in the region of interest as the information regarding the size of the region of interest.

### Claim 3 (depends on 1)

The image decoding apparatus according to claim 1, further comprising:
a third acquisition unit configured to acquire the number of tiles that the image decoding apparatus is capable of processing within a unit time period,
wherein the size acquisition unit acquires the number of tiles included in the region of interest as the information regarding the size of the region of interest, and
wherein the determination unit determines, among the frame rates acquired by the frame rates information acquisition unit and corresponding to the plurality of temporal layers, a frame rate lower than or equal to a frame rate calculated from the number of tiles included in the region of interest and the number of tiles that the image decoding apparatus is capable of processing within a unit time period to be the frame rate for the region of interest.

### Claim 4 (depends on 1)

The image decoding apparatus according to claim 1, wherein the decoding unit decodes the region of interest in accordance with a temporal layer corresponding to the frame rate determined by the determination unit.

### Claim 5 (depends on 1)

The image decoding apparatus according to claim 1, wherein the determination unit determines either of the frame rates acquired by the frame rates information acquisition unit and corresponding to the plurality of temporal layers to be a frame rate used in entire-view display, in which the one or more images capable of being decoded are entirely displayed, or partial-view display, in which the region of interest is displayed.

### Claim 6 (depends on 5)

The image decoding apparatus according to claim 5, wherein the determination unit determines a frame rate used in the entire-view display in a case where the region of interest is not specified, and determines a frame rate used in the partial-view display in a case where the region of interest is specified and where a region that is not the entirety but a part of the one or more images capable of being decoded is specified as the region of interest.

### Claim 7

An image decoding method, the image decoding method comprising:
acquiring information regarding a size of a region of interest that is a partial region in an image capable of being decoded;
determining a frame rate for the region of interest in accordance with the information regarding the size of the region of interest acquired; and
acquiring encoded data corresponding to the region of interest that is a partial region in the image and decode the encoded data corresponding to the region of interest, in accordance with the frame rate determined.

### Claim 8

A non-transitory storage medium storing a program causing a computer to execute an image decoding process, the image decoding process comprising:
acquiring information regarding a size of a region of interest that is a partial region in an image capable of being decoded;
determining a frame rate for the region of interest in accordance with the information regarding the size of the region of interest acquired; and
acquiring encoded data corresponding to the region of interest that is a partial region in the image and decode the encoded data corresponding to the region of interest, in accordance with the frame rate determined.

### Claim 9

An image decoding apparatus comprising:
a size acquisition unit configured to acquire information regarding a size of a region of interest that is a partial region in an image capable of being decoded;
a determination unit configured to determine a frame rate for the region of interest in accordance with the information regarding the size of the region of interest acquired by the size acquisition unit; and
a decoding unit configured to acquire encoded data corresponding to the region of interest that is a partial region in the image and decode the encoded data corresponding to the region of interest, in accordance with the frame rate determined by the determination unit.
