Image processing apparatus, image processing method and image processing program

An image processing apparatus to process an input image, the input image having a first resolution and including a plurality of sub-areas, the apparatus comprising:

• an up-sampling section configured to carry out up-sampling processing to increase the number of pixels composing the input image, to generate an up-sampled image having a second resolution higher than said first resolution;
• a motion-compensated image generation section configured to perform correction processing to adjust a photographing-object position on said up-sampled image based on a difference between said up-sampled image and a reference image having said second resolution, to generate a motion-compensated image;
• and
• an output-image generation section configured to receive and process said motion-compensated image and said up-sampled image to generate an output blended image, wherein the output blended image is equivalent to an image obtained by blending a super-resolution processing-result image obtained as a result of super-resolution processing carried out to increase the resolution of said input image with a noise-reduction processing-result image obtained as a result of noise reduction processing carried out to reduce noises of said input image.

An image processing method for an image processing apparatus to process an input image, said apparatus including an up-sampling section, a motion-compensated image generation section, a blending processing section and an output-image generation section, said input image having a first resolution and including a plurality of sub-areas, said image processing method comprising:

• performing, by said up-sampling section, up-sampling processing to increase the number of pixels composing the input image, to generate an up-sampled image having a second resolution higher than said first resolution;
• performing, by said motion-compensated image generation section, correction processing to adjust a photographing-object position on said up-sampled image based on a difference between said up-sampled image and a reference image having said second resolution, to generate a motion-compensated image;
• blending, by said blending processing section, said up-sampled image with said motion-compensated image based on a blending coefficient, to generate an intermediate blended image, wherein the blending processing section compares said up-sampled image with said motion-compensated image for each of the image sub-areas and sets the blending coefficient based on the comparison;
• and
• receiving and processing, by said output-image generation section, said intermediate blended image and said up-sampled image to generate an output blended image, wherein the output blended image is equivalent to an image obtained by blending a super-resolution processing-result image obtained as a result of super-resolution processing carried out to increase the resolution of said input image with a noise-reduction processing-result image obtained as a result of noise reduction processing carried out to reduce noises of said input image.

An image processing method for an image processing apparatus to process an input image, said apparatus including an up-sampling section, a motion-compensated image generation section and an output-image generation section, said input image having a first resolution and including a plurality of sub-areas, said image processing method comprising:

• performing, by said up-sampling section, up-sampling processing to increase the number of pixels composing the input image, to generate an up-sampled image having a second resolution higher than said first resolution;
• performing, by said motion-compensated image generation section, correction processing to adjust a photographing-object position on said up-sampled image based on a difference between said up-sampled image and a reference image having said second resolution, to generate a motion-compensated image;
• and
• receiving and processing, by said output-image generation section, said motion-compensated image and said up-sampled image to generate an output blended image, wherein the output blended image is equivalent to an image obtained by blending a super-resolution processing-result image obtained as a result of super-resolution processing carried out to increase the resolution of said input image with a noise-reduction processing-result image obtained as a result of noise reduction processing carried out to reduce noises of said input image.

A non-transitory computer-readable medium including instructions, executable by a processor, to cause an image processing apparatus to perform an image processing method on an input image, said apparatus including an up-sampling section, a motion-compensated image generation section, a blending processing section and an output-image generation section, said input image having a first resolution and including a plurality of sub-areas, said image processing method comprising:

• performing, by said up-sampling section, up-sampling processing to increase the number of pixels composing the input image, to generate an up-sampled image having a second resolution higher than said first resolution;
• performing, by said motion-compensated image generation section, correction processing to adjust a photographing-object position on said up-sampled image based on a difference between said up-sampled image and a reference image having said second resolution, to generate a motion-compensated image;
• blending, by said blending processing section, said up-sampled image with said motion-compensated image based on a blending coefficient, to generate an intermediate blended image, wherein the blending processing section compares said up-sampled image with said motion-compensated image for each of the image sub-areas and sets the blending coefficient based on the comparison;
• and
• receiving and processing, by said output-image generation section, said intermediate blended image and said up-sampled image to generate an output blended image, wherein the output blended image is equivalent to an image obtained by blending a super-resolution processing-result image obtained as a result of super-resolution processing carried out to increase the resolution of said input image with a noise-reduction processing-result image obtained as a result of noise reduction processing carried out to reduce noises of said input image.

A non-transitory computer-readable medium including instructions, executable by a processor, to cause an image processing apparatus to perform an image processing method on an input image, said apparatus including an up-sampling section, a motion-compensated image generation section and an output-image generation section, said input image having a first resolution and including a plurality of sub-areas, said image processing method comprising:

• performing, by said up-sampling section, up-sampling processing to increase the number of pixels composing the input image, to generate an up-sampled image having a second resolution higher than said first resolution;
• performing, by said motion-compensated image generation section, correction processing to adjust a photographing-object position on said up-sampled image based on a difference between said up-sampled image and a reference image having said second resolution, to generate a motion-compensated image;
• and
• receiving and processing, by said output-image generation section, said motion-compensated image and said up-sampled image to generate an output blended image, wherein the output blended image is equivalent to an image obtained by blending a super-resolution processing-result image obtained as a result of super-resolution processing carried out to increase the resolution of said input image with a noise-reduction processing-result image obtained as a result of noise reduction processing carried out to reduce noises of said input image.