# US 11,115,670 B2 · Image encoding apparatus, image encoding method, recording medium and program, image decoding apparatus, image decoding method, and recording medium and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,670 B2 - Document ID: US11115670B2 - Status: Granted - Kind: B2 - Application number: 16/950,616 - Filed: 2020-11-17 - Published: 2021-03-11 - Granted: 2021-09-07 - Earliest claimed: 2013-07-12 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Mitsuru Maeda; Masato Shima - Web page: https://patentgrep.com/patent/US11115670B2 ## CPC - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/167: Position within a video image, e.g. region of interest [ROI] - H04N 19/187: the unit being a scalable video layer - H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder - H04N 19/90: using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present invention relates to specification of a tile capable of being independently processed to process a certain area at high speed in encoding and decoding of tiles resulting from division of an image in hierarchical coding of the image. An image encoding apparatus that performs the hierarchical coding of an input image with multiple layers includes an acquiring unit and an encoding unit. The acquiring unit acquires a first image generated from the input image and a second image having resolution different from that of the first image. In the encoding of a first area in the first image acquired by the acquiring unit, the encoding unit performs the encoding using a second area existing at the relatively same position as that of the first area in the first image in the second image as a reference image. ## Claims ### Claim 1 An image encoding apparatus that performs hierarchical coding of images composing a moving image with a plurality of layers, the image encoding apparatus comprising: a generating unit that generates a second image, wherein the second image corresponds to a second layer which is different from a first layer to which the first image corresponds; an encoding unit that encodes a first tile set composed of one or more tiles in the first image and a second tile set composed of one or more tiles in the second image; and an information encoding unit, wherein the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the encoding unit encodes the first tile set without reference to any tile set in the first image other than the first tile set, and encodes the second tile set without reference to any tile set in the second image other than the second tile set, wherein, in a case where the encoding unit encodes the first tile set with reference to at least a part of an area of the second image, the encoding unit encodes the first tile set without reference to any tile set in the second image other than the second tile set, wherein the information encoding unit encodes a supplemental enhancement information (SEI) message indicating constraint related to a decoding process of the first tile set and the second tile set, and wherein the SEI message includes a top left tile index indicating a position of a top left tile included in a tile set. ### Claim 2 (depends on 1) The image encoding apparatus according to claim 1, wherein the first image and the second image are different in resolution or image quality. ### Claim 3 (depends on 1) The image encoding apparatus according to claim 1, wherein the first layer is an extension layer and the second layer is a base layer. ### Claim 4 (depends on 1) The image encoding apparatus according to claim 1, wherein the first tile set in the first image and the second tile set in the second image are arranged at same positions in the first image and the second image, respectively. ### Claim 5 (depends on 1) The image encoding apparatus according to claim 1, wherein the SEI message includes information indicating at least a position of the first tile set. ### Claim 6 An image decoding apparatus that decodes encoded data generated by performing hierarchical coding of images composing a moving image with a plurality of layers, the image decoding apparatus comprising: an information decoding unit that decodes a SEI message indicating constraint related to a decoding process of a tile set composed of one or more tiles, the SEI message including a top left tile index indicating a position of a top left tile included in the tile set; and a decoding unit that decodes a first tile set in a first image and a second tile set in a second image according to the SEI message, wherein the first image corresponds to a first layer and the second image corresponds to a second layer which is different from the first layer, wherein, in a case where the SEI massage is decoded by the information decoding unit, the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the decoding unit decodes the first tile set without reference to any tile set in the first image other than the first tile set, and decodes the second tile set without reference to any tile set in the second image other than the second tile set, and wherein, in a case where the SEI massage is decoded by the information decoding unit and the decoding unit decodes the first tile set with reference to at least a part of an area of the second image, the decoding unit decodes the first tile set, without reference to any tile set in the second image other than the second tile set. ### Claim 7 (depends on 6) The image decoding apparatus according to claim 6, wherein the first image and the second image are different in resolution or image quality. ### Claim 8 (depends on 6) The image decoding apparatus according to claim 6, wherein the first layer is an extension layer and the second layer is a base layer. ### Claim 9 (depends on 6) The image decoding apparatus according to claim 6, wherein the first tile set in the first image and the second tile set in the second image are arranged at same positions in the first image and the second image, respectively. ### Claim 10 (depends on 6) The image decoding apparatus according to claim 6, wherein the SEI message includes information indicating at least a position of the first tile set. ### Claim 11 An image encoding method that performs hierarchical coding of images composing a moving image with a plurality of layers, the image encoding method comprising: generating a second image, wherein the second image corresponds to a second layer which is different from a first layer to which the first image corresponds; and encoding a first tile set composed of one or more tiles in the first image and a second tile set composed of one or more tiles in the second image; wherein the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the first tile set is encoded without reference to any tile set in the first image other than the first tile set, and encodes the second tile set without reference to any tile set in the second image other than the second tile set, wherein, in a case where the first tile set is encoded with reference to at least apart of an area of the second image, the first tile set is encoded without reference to any tile set in the second image other than the second tile set, wherein a supplemental enhancement information (SEI) message is encoded indicating constraint related to a decoding process of the first tile set and the second tile set, and wherein the SEI message includes a top left tile index indicating a position of a top left tile included in a tile set. ### Claim 12 An image decoding method that decodes encoded data generated by performing hierarchical coding of images composing a moving image with a plurality of layers, the image decoding method comprising: decoding a SEI message indicating constraint related to a decoding process of a tile set composed of one or more tiles, the SEI message including a top left tile index indicating a position of a top left tile included in the tile set; and decoding a first tile set in a first image and a second tile set in a second image according to the SEI message, wherein the first image corresponds to a first layer and the second image corresponds to a second layer which is different from the first layer, wherein, in a case where the SEI message is decoded, the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the first tile set is decoded without reference to any tile set in the first image other than the first tile set, and decodes the second tile set without reference to any tile set in the second image other than the second tile set, and wherein, in a case where the SEI message is decoded and the first tile set is decoded with reference to at least a part of an area of the second image, the first tile set is decoded, without reference to any tile set in the second image other than the second tile set. ### Claim 13 A non-transitory computer readable storage medium storing a program to cause a computer to execute an image encoding method that performs hierarchical coding of images composing a moving image with a plurality of layers, the image encoding method comprising: generating a second image, wherein the second image corresponds to a second layer which is different from a first layer to which the first image corresponds; and encoding a first tile set composed of one or more tiles in the first image and a second tile set composed of one or more tiles in the second image; wherein the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the first tile set is encoded without reference to any tile set in the first image other than the first tile set, and encodes the second tile set without reference to any tile set in the second image other than the second tile set, wherein, in a case where the first tile set is encoded with reference to at least apart of an area of the second image, the first tile set is encoded without reference to any tile set in the second image other than the second tile set, wherein a supplemental enhancement information (SEI) message is encoded indicating constraint related to a decoding process of the first tile set and the second tile set, and wherein the SEI message includes a top left tile index indicating a position of a top left tile included in a tile set. ### Claim 14 A non-transitory computer readable storage medium storing a program to cause a computer to execute an image decoding method that decodes encoded data generated by performing hierarchical coding of images composing a moving image with a plurality of layers, the image decoding method comprising: decoding a SEI message indicating constraint related to a decoding process of a tile set composed of one or more tiles, the SEI message including a top left tile index indicating a position of a top left tile included in the tile set; and decoding a first tile set in a first image and a second tile set in a second image according to the SEI message, wherein the first image corresponds to a first layer and the second image corresponds to a second layer which is different from the first layer, wherein, in a case where the SEI message is decoded, the second tile set is arranged, in the second image, at a position corresponding to the first tile set, wherein the first tile set is decoded without reference to any tile set in the first image other than the first tile set, and decodes the second tile set without reference to any tile set in the second image other than the second tile set, and wherein, in a case where the SEI message is decoded and the first tile set is decoded with reference to at least apart of an area of the second image, the first tile set is decoded, without reference to any tile set in the second image other than the second tile set.