Image processing device, image processing method and recording medium

A camera array system comprising:

• a camera array in which cameras mounting any of two or more types of filter set are arranged in an array;
• a first color information calculation unit configured to calculate, from pixel values of a plurality of pieces of photographed image data photographed by the camera array, first color information that is color information in a common color space;
• a distance information calculation unit configured to calculate a corresponding point between images indicated by the plurality of pieces of photographed image data by using the calculated first color information, to thereby calculate information on a depth of a subject in the image indicated by the photographed image data;
• a second color information calculation unit configured to calculate, from the pixel values of the plurality of pieces of photographed image data, second color information that is color information used for reproducing a color of the subject;
• and
• a combination unit configured to combine the plurality of pieces of photographed image data by using the calculated depth information and second color information.

An image processing method for performing processing on a plurality of pieces of photographed image data photographed by a camera array in which cameras mounting any of two or more types of filter set are arranged in an array, the image processing method comprising:

• a first color information calculation step of calculating, from pixel values of the plurality of pieces of photographed image data, first color information that is color information in a common color space;
• a distance information calculation step of calculating a corresponding point between images indicated by the plurality of pieces of photographed image data by using the calculated first color information, to thereby calculate information on a depth of a subject indicated by the photographed image data;
• a second color information calculation step of calculating, from the pixel values of the plurality of pieces of photographed image data, second color information that is color information used for reproducing a color of the subject;
• and
• a combination step of combining the plurality of photographed images by using the calculated depth information and second color information.

A computer-readable recording medium having computer-executable instructions for performing an image processing method for causing a computer to perform processing on a plurality of pieces of photographed image data photographed by a camera array in which cameras mounting any of two or more types of filter set are arranged in an array, the method comprising:

• a first color information calculation step of calculating, from pixel values of the plurality of pieces of photographed image data, first color information that is color information in a common color space;
• a distance information calculation step of calculating a corresponding point between images indicated by the plurality of pieces of photographed image data by using the calculated first color information, to thereby calculate information on a depth of a subject indicated by the photographed image data;
• a second color information calculation step of calculating, from the pixel values of the plurality of pieces of photographed image data, second color information that is color information used for reproducing a color of the subject;
• and
• a combination step of combining the plurality of photographed images by using the calculated depth information and second color information.