Image processing device, image generating system, method, and program

An image generation method for generating, from a first moving image, which is a moving image of a first color component of a subject, and a second moving image, which is a moving image of a second color component of the subject, a new moving image representing the subject, the image generation method comprising the steps of:

• acquiring the first moving image and the second moving image having different resolutions and different frame rates or different exposure times from each other;
• determining, based on a pixel value of each of pixels in each of frame images of the first moving image and the second moving image, whether or not each pixel is saturated or blocked-up-shadowed;
• and
• generating, from the first moving image and the second moving image, a new image having a frame rate which is equal to or higher than the frame rate of the first moving image and the second moving image and having a resolution of the frame images which is equal to or higher than the resolution of the first moving image and the second moving image;
• wherein for a pixel not determined in the step of determining as being saturated or being blocked-up-shadowed, the step of generating a new image generates a new moving image fulfilling a first condition which indicates that an error between a pixel value of each of the acquired first moving image and second moving image and a sum of pixel values, of frame images of the new moving image, corresponding to the pixel values temporally and spatially is smaller than a prescribed value, and for a pixel determined in the step of determining as being saturated or being blocked-up-shadowed, the step of generating a new image generates a new moving image which does not fulfill the first condition.

A computer program, stored on a non-transitory computer-readable storage medium, executable by a computer of an image generation device for generating, from a first moving image, which is a moving image of a first color component of a subject, and a second moving image, which is a moving image of a second color component of the subject, a new moving image representing the subject, the computer program causing the computer to execute the steps of:

• acquiring the first moving image and the second moving image having different resolutions and different frame rates or different exposure times from each other;
• determining, based on a pixel value of each of pixels in each of frame images of the first moving image and the second moving image, whether or not each pixel is saturated or blocked-up-shadowed;
• and
• generating, from the first moving image and the second moving image, a new image having a frame rate which is equal to or higher than the frame rate of the first moving image and the second moving image and having a resolution of the frame images which is equal to or higher than the resolution of the first moving image and the second moving image;
• wherein for a pixel not determined in the step of determining as being saturated or being blocked-up-shadowed, the step of generating a new image generates a new moving image fulfilling a first condition which indicates that an error between a pixel value of each of the acquired first moving image and second moving image and a sum of pixel values, of frame images of the new moving image, corresponding to the pixel values temporally and spatially is smaller than a prescribed value, and for a pixel determined in the step of determining as being saturated or being blocked-up-shadowed, the step of generating a new image generates a new moving image which does not fulfill the first condition.