Image processing device and method, and imaging device

An image processing method of an image processing apparatus for processing an image formed of pixel data of frames, obtained by a sensor including detector elements, each having a time integration effect, comprising:

• a correlation detection step for detecting a correlation between pixel data of a target pixel in a target frame from among frames and pixel data of a corresponding pixel in a first frame adjacent to the target frame, and a correlation between the pixel data of the target pixel in the target frame and pixel data of a corresponding pixel in a second frame adjacent to the target frame, and
• a pixel data generation step for generating pixel data of a first pixel in a first synthesis frame generated between the target frame and one of the first and second frames containing the corresponding pixel having the pixel data with a larger correlation, based on the pixel data of one of the corresponding pixels in the first and second frames having the larger correlation detected in the correlation detection step, and for generating pixel data of a second pixel in a second synthesis frame generated between the target frame and the other of the first and second frames, based on the pixel data of the target pixel and the pixel data of the first pixel.

A storage medium storing an image processing, computer readable program for processing an image formed of pixel data of frames, obtained by a sensor including detector elements, each having a time integration effect, the program comprising:

• a correlation detection step for detecting a correlation between pixel data of a target pixel in a target frame from among frames and pixel data of a corresponding pixel in a first frame adjacent to the target frame, and a correlation between the pixel data of the target pixel in the target frame and pixel data of a corresponding pixel in a second frame adjacent to the target frame, and
• a pixel data generation step for generating pixel data of a first pixel in a first synthesis frame generated between the target frame and one of the first and second frames containing the corresponding pixel having the pixel data with a larger correlation, based on the pixel data of one of the corresponding pixels in the first and second frames having the larger correlation detected in the correlation detection step, and for generating pixel data of a second pixel in a second synthesis frame generated between the target frame and the other of the first and second frames, based on the pixel data of the target pixel and the pixel data of the first pixel.

A program to be executed on a computer controlling an image processing apparatus for processing an image formed of pixel data of frames, obtained by a sensor including detector elements, each having a time integration effect, the program comprising:

• a correlation detection step for detecting a correlation between pixel data of a target pixel in a target frame from among frames and pixel data of a corresponding pixel in a first frame adjacent to the target frame, and a correlation between the pixel data of the target pixel in the target frame and pixel data of a corresponding pixel in a second frame adjacent to the target frame, and
• a pixel data generation step for generating pixel data of a first pixel in a first synthesis frame generated between the target frame and one of the first and second frames containing the corresponding pixel having the pixel data with a larger correlation, based on the pixel data of one of the corresponding pixels in the first and second frames having the larger correlation detected in the correlation detection step, and for generating pixel data of a second pixel in a second synthesis frame generated between the target frame and the other of the first and second frames based on the pixel data of the target pixel and the pixel data of the first pixel.

An image pickup device comprising image pickup means for outputting, as pixel data of frames, an object image picked up by an image pickup unit having a predetermined number of pixels, each having a time integration effect,

• correlation detector means for detecting a correlation between pixel data of a target pixel in a target frame from among frames and pixel data of a corresponding pixel in a first frame adjacent to the target frame, and a correlation between the pixel data of the target pixel in the target frame and pixel data of a corresponding pixel in a second frame adjacent to the target frame, and
• pixel data generator means for generating pixel data of a first pixel in a first synthesis frame generated between the target frame and one of the first and second frames containing the corresponding pixel having the pixel data with a larger correlation, based on the pixel data of one of the corresponding pixels in the first and second frames having the larger correlation detected by the correlation detector means, and for generating pixel data of a second pixel in a second synthesis frame generated between the target frame and the other of the first and second frames, based on the pixel data of the target pixel and the pixel data of the first pixel.