Method and apparatus for reconstructing a high-resolution image by using multi-layer low-resolution images

An apparatus for reconstructing a high-resolution image by using multi-layer low-resolution images, the apparatus comprising:

• a low-resolution image layer division unit for dividing a low-resolution image into a plurality of texture layer low-resolution images and a plurality of base layer low-resolution images;
• a texture layer high-resolution image generation unit for generating a texture layer high-resolution image by compositing the plurality of the texture layer low-resolution images;
• a base layer high-resolution image generation unit for generating a base layer high-resolution image by compositing the plurality of the base layer low-resolution images;
• and
• a high-resolution image composition unit for outputting a high-resolution image by compositing the texture layer high-resolution image and the base layer high-resolution image,
• wherein the base layer low-resolution images include low-frequency components and strong directional edge components of the low-resolution image, and the texture layer low-resolution images include high-frequency components representing detail information obtained by excluding the low-frequency components and the strong directional edge components from the low-resolution image,
• wherein the texture layer high-resolution image generation unit generates the texture layer high-resolution image by performing weighted sum filtering on a first current frame of each of the plurality of the texture layer low-resolution images, and at least one first temporally neighboring frame of the first current frame and at least one first spatially neighboring frame of the first current frame, by using the neighboring frames motion-compensated based on the motion information, and
• wherein the base layer high-resolution image generation unit generates the base layer high-resolution image by performing weighted sum filtering on a second current frame of each of the plurality of the base layer low-resolution images, and at least one temporally neighboring frame of the second current frame and at least one spatially neighboring frame of the second current frame, by using neighboring frames motion-compensated based on the motion information.

An apparatus for reconstructing a high-resolution image by using multi-layer low-resolution images, the apparatus comprising:

• a low-resolution image multi-layer division unit for dividing an input low-resolution image into a plurality of individual layer low-resolution images with respect to each of a plurality of layers;
• an individual layer high-resolution image generation unit for generating an individual layer high-resolution image by compositing the plurality of the individual layer low-resolution images with respect to each of the plurality of the layers;
• and
• a multi-layer high-resolution image composition unit for outputting a high-resolution image by compositing a plurality of individual layer high-resolution images generated with respect to the plurality of layers,
• wherein base layer low-resolution images include low-frequency components and strong directional edge components of the input low-resolution image, and the texture layer low-resolution images include high-frequency components representing detail information obtained by excluding the low-frequency components and the strong directional edge components from the input low-resolution image,
• wherein the plurality of individual layer high-resolution images comprise a generated texture layer high-resolution image and a generated base layer high-resolution image,
• wherein the texture layer high-resolution image is generated by performing weighted sum filtering on a first current frame of each of the plurality of the texture layer low-resolution images, at least one first temporally neighboring frame of the first current frame and at least one first spatially neighboring frame of the first current frame;
• and
• wherein the base layer high-resolution image is generated by performing weighted sum filtering on a second current frame of each of the plurality of the base layer low-resolution images, at least one second temporally neighboring frame of the second current frame and at least one second spatially neighboring frame of the second current frame.

non-transitory computer readable recording medium having recorded thereon a computer program for executing a method of reconstructing a high-resolution image by using multi-layer low-resolution images, the method comprising:

• dividing a low-resolution image into a plurality of texture layer low-resolution images and a plurality of base layer low-resolution images;
• generating a texture layer high-resolution image by compositing the plurality of the texture layer low-resolution images and generating a base layer high-resolution image by compositing the plurality of the base layer low-resolution images;
• and
• outputting a high-resolution image by compositing the texture layer high-resolution image and the base layer high-resolution image,
• wherein the base layer low-resolution images include low-frequency components and strong directional edge components of the low-resolution image, and the texture layer low-resolution images include high-frequency components representing detail information obtained by excluding the low-frequency components and the strong directional edge components from the low-resolution image, and
• wherein the generating of the texture layer high-resolution image and the base layer high-resolution image comprises:
• generating the texture layer high-resolution image by performing weighted sum filtering on a first current frame of each of the plurality of the texture layer low-resolution images, at least one first temporally neighboring frame of the first current frame and at least one first spatially neighboring frame of the first current frame;
• and
• generating the base layer high-resolution image by performing weighted sum filtering on a second current frame of each of the plurality of the base layer low-resolution images, at least one second temporally neighboring frame of the second current frame and at least one second spatially neighboring frame of the second current frame.

A method of reconstructing a high-resolution image by using multi-layer low-resolution images, said method comprising:

• dividing a low-resolution image into at least one texture layer low-resolution image and at least one base layer low-resolution image;
• generating a texture layer high-resolution image based on said at least one texture layer low-resolution image;
• generating a base layer high-resolution image based on said at least one base layer low-resolution image;
• generating the high-resolution image based on said texture layer high-resolution image and said base layer high-resolution image,
• wherein the base layer low-resolution images include low-frequency components and strong directional edge components of the low-resolution image, and the texture layer low-resolution images include high-frequency components representing detail information obtained by excluding the low-frequency components and the strong directional edge components from the low-resolution image,
• wherein the generating of the texture layer high-resolution image and the base layer high-resolution image comprises:
• generating the texture layer high-resolution image by performing weighted sum filtering on a first current frame of each of the at least one texture layer low-resolution image, at least one first temporally neighboring frame of the first current frame and at least one first spatially neighboring frame of the first current frame;
• and
• generating the base layer high-resolution image by performing weighted sum filtering on a second current frame of each of the at least one of the base layer low-resolution image, at least one second temporally neighboring frame of the second current frame and at least one second spatially neighboring frame of the second current frame.

An apparatus for reconstructing a high-resolution image by using multi-layer low-resolution images, the apparatus comprising:

• a low-resolution image layer division unit for dividing a low-resolution image into at least one texture layer low-resolution image and at least one base layer low-resolution image;
• a texture layer high-resolution image generation unit for generating a texture layer high-resolution image based on said at least one texture layer low-resolution image;
• a base layer high-resolution image generation unit for generating a base layer high-resolution image based on said at least one base layer low-resolution image;
• and a high-resolution image composition unit for generating the high-resolution image based on said texture layer high-resolution image and said base layer high-resolution image,
• wherein the base layer low-resolution images include low-frequency components and strong directional edge components of the low-resolution image, and the texture layer low-resolution images include high-frequency components representing detail information obtained by excluding the low-frequency components and the strong directional edge components from the low-resolution image,
• wherein the texture layer high-resolution image generation unit generates the texture layer high-resolution image by performing weighted sum filtering on a first current frame of each of the at least one texture layer low-resolution image, and at least one first temporally neighboring frame of the first current frame and at least one first spatially neighboring frame of the first current frame, by using the neighboring frames motion-compensated based on the motion information, and
• wherein the base layer high-resolution image generation unit generates the base layer high-resolution image by performing weighted sum filtering on a second current frame of each of the at least one base layer low-resolution image, and at least one temporally neighboring frame of the second current frame and at least one spatially neighboring frame of the second current frame, by using neighboring frames motion-compensated based on the motion information.