Image processing apparatus and method, and image-capturing apparatus

An image processing method for performing image-processing on image data which is formed of a predetermined number of pixel data obtained by an image-capturing device including a predetermined number of pixels and having a time integrating function, said image processing method comprising:

• an area specifying step of specifying, in a first period of time corresponding to one screen, an uncovered background area in which foreground object components forming a foreground object of a designated frame of the image data and background object components forming a background object of the designated frame are mixed, the uncovered background area being formed at a trailing end in a direction in which the foreground object is moving, said area specifying step of specifying, in a second period of time corresponding to one screen subsequent to the first period of time, a foreground area consisting of only the foreground object components and a background area consisting of only the background object components, and said area specifying step of specifying, in a third period of time corresponding to one screen subsequent to the second period of time, a covered background area in which the foreground object components and the background object components are mixed, the covered background area being formed at a leading end in a direction in which the foreground object is moving;
• a mixture-ratio detection step of detecting a mixture ratio indicating a ratio of the foreground object components and the background object components in the uncovered background area and in the covered background area;
• and
• a foreground/background separation step of separating the pixel data of the pixels belonging to the uncovered background area and to the covered background area into the foreground object components and the background object components based on the mixture ratio so as to generate a foreground component image consisting of only the foreground object components and a background component image consisting of only the background component image in the designated frame.

A recording medium in which a computter-readable program is recorded, said program being used for performing image-processing on image data which is formed of a predetermined number of pixel data obtained by an image-capturing device including a predetermined number of pixels and having a time integrating function, said program comprising:

• an area specifying step of specifying, in a first period of time corresponding to one screen, an uncovered background area in which foreground object components forming a foreground object of a designated frame of the image data and background object components forming a background object of the designated frame are mixed, the uncovered background area being formed at a trailing end in a direction in which the foreground object is moving, said area specifying step of specifying, in a second period of time corresponding to one screen subsequent to the first period of time, a foreground area consisting of only the foreground object components and a background area consisting of only the background object components, and said area specifying step of specifying, in a third period of time corresponding to one screen subsequent to the second period of time, a covered background area in which the foreground object components and the background object components are mixed, the covered background area being formed at a leading end in a direction in which the foreground object is moving;
• a mixture-ratio detection step of detecting a mixture ratio indicating a ratio of the foreground object components and the background object components in the uncovered background area and in the covered background area;
• and
• a foreground/background separation step of separating the pixel data of the pixels belonging to the uncovered background area and to the covered background area into the foreground object components and the background object components based on the mixture ratio so as to generate a foreground component image consisting of only the foreground object components and a background component image consisting of only the background component image in the designated frame.

A program for allowing a computer which performs image-processing on image data formed of a predetermined number of pixel data obtained by an image-capturing device including a predetermined number of pixels and having a time integrating function to execute:

• an area specifying step of specifying, in a first period of time corresponding to one screen, an uncovered background area in which foreground object components forming a foreground object of a designated frame of the image data and background object components forming a background object of the designated frame are mixed, the uncovered background area being formed at a trailing end in a direction in which the foreground object is moving, said area specifying step of specifying, in a second period of time corresponding to one screen subsequent to the first period of time, a foreground area consisting of only the foreground object components and a background area consisting of only the background object components, and said area specifying step of specifying, in a third period of time corresponding to one screen subsequent to the second period of time, a covered background area in which the foreground object components and the background object components are mixed, the covered background area being formed at a leading end in a direction in which the foreground object is moving;
• a mixture-ratio detection step of detecting a mixture ratio indicating a ratio of the foreground object components and the background object components in the uncovered background area and in the covered background area;
• and
• a foreground/background separation step of separating the pixel data of the pixels belonging to the uncovered background area and to the covered background area into the foreground object components and the background object components based on the mixture ratio so as to generate a foreground component image consisting of only the foreground object components and a background component image consisting of only the background component image in the designated frame.

An image-capturing apparatus comprising:

• image-capturing means for performing image-processing on image data which is formed of a predetermined number of pixel data obtained by an image-capturing device including a predetermined number of pixels and having a time integrating function;
• area specifying means for specifying, in a first period of time corresponding to one screen, an uncovered background area in which foreground object components forming a foreground object of a designated frame of the image data and background object components forming a background object of the designated frame are mixed, the uncovered background area being formed at a trailing end in a direction in which the foreground object is moving, said area specifying means for specifying, in a second period of time corresponding to one screen subsequent to the first period of time, a foreground area consisting of only the foreground object components and a background area consisting of only the background object components, and said area specifying means for specifying, in a third period of time corresponding to one screen subsequent to the second period of time, a covered background area in which the foreground object components and the background object components are mixed, the covered background area being formed at a leading end in a direction in which the foreground object is moving;
• mixture-ratio detection means for detecting a mixture ratio indicating a ratio of the foreground object components and the background object components in the uncovered background area and in the covered background area;
• and
• foreground/background separation means for separating the pixel data of the pixels belonging to the uncovered background area and to the covered background area into the foreground object components and the background object components based on the mixture ratio, and for generating a foreground component image consisting of only the foreground object components and a background component image consisting of only the background component image in the designated frame.