Image processing device

An image processing method for processing image data containing a predetermined number of pieces of pixel data obtained by an image pickup element having a predetermined number of pixels, each pixel having a time integration effect, the image processing method comprising:

• a background pixel extracting step for extracting pixel data of a frame prior to or subsequent to a target frame, corresponding to a target pixel of the target frame in the image data, as background pixel data of an object, which serves as a background, from among a plurality of objects of the image data,
• a target frame pixel extracting step for extracting pixel data of the target pixel in the target frame and pixel data of a pixel in the vicinity of the target pixel in the target frame,
• a relational equation generating step for generating a plurality of equations representing, in connection with the target pixel, the relationship between the data of the target pixel and the pixel in the vicinity of the target pixel and the background pixel data corresponding to the data of the target pixel and the pixel in the vicinity of the target pixel, and
• a mixture ratio detecting step for detecting a mixture ratio indicating a mixed state of the plurality of objects in the real world in connection with the target pixel based on the relational equations.

A storage medium for storing a computer readable software program for processing image data containing a predetermined number of pieces of pixel data obtained by an image pickup element having a predetermined number of pixels, each pixel having a time integration effect, the image processing program comprising:

• a background pixel extracting step for extracting pixel data of a frame prior to or subsequent to a target frame, corresponding to a target pixel of the target frame in the image data, as background pixel data of an object, which serves as a background, from among a plurality of objects of the image data,
• a target frame pixel extracting step for extracting pixel data of the target pixel in the target frame and pixel data of a pixel in the vicinity of the target pixel in the target frame,
• a relational equation generating step for generating a plurality of equations representing, in connection with the target pixel, the relationship between data of the target pixel and the pixel in the vicinity of the target pixel and the background pixel data corresponding to the data of the target pixel and the pixel in the vicinity of the target pixel, and
• a mixture ratio detecting step for detecting a mixture ratio indicating a mixed state of the plurality of objects in the real world in connection with the target pixel based on the relational equations.

An image pickup device comprising:

• image pickup means for outputting, as image data containing a plurality of pieces of pixel data, an image of an object picked up by an image pickup element having a predetermined number of pixels, each pixel having a time integration effect,
• background pixel extractor means for extracting pixel data of a frame prior to or subsequent to a target frame, corresponding to a target pixel of the target frame in the image data, as background pixel data of an object, which serves as a background, from among a plurality of objects of the image data,
• target frame pixel extractor means for extracting pixel data of the target pixel in the target frame and pixel data of a pixel in the vicinity of the target pixel in the target frame,
• relational equation generator means for generating a plurality of equations representing, in connection with the target pixel, the relationship between data of the target pixel and the pixel in the vicinity of the target pixel and the background pixel data corresponding to the data of the target pixel and the pixel in the vicinity of the target pixel, and
• mixture ratio detector means for detecting a mixture ratio indicating a mixed state of the plurality of objects in the real world in connection with the target pixel based on the relational equations.