System and method for generating a depth map and fusing images from a camera array

An apparatus for fusing images from a camera array, the apparatus comprising:

• a computer processor to execute a set of program code instructions;
• and
• a memory to hold the program code instructions, in which the program code instructions comprises program code to perform:
• obtaining a plurality image pixels from at least one image sensor, wherein the plurality of image pixels comprises:
• a first image of a first color,
• a second image of the same first color,
• a third image of a second color, and
• a fourth image of a third color;
• constructing a first disparity map using the plurality of image pixels by calculating pixel disparities between the first image and the second image via mono-chromatic stereo matching, the first disparity map being associated with a first direction;
• constructing a second disparity map, the second disparity map being associated with a second direction;
• warping the third image, along the second direction using the second disparity map, to create a corrected third image;
• warping the fourth image, along the first direction using the first disparity map and along the second direction using the second disparity map, to create a corrected fourth image;
• and
• combining the first image, the corrected third image, and the corrected fourth image to create a fused multi-channel color image.

A method comprising:

• obtaining a plurality image pixels from at least one image sensor, wherein the plurality of image pixels comprises:
• a first image of a first color, the first image captured at a first location,
• a second image of the same first color, the second image captured at a second location,
• a third image of a second color, the third image captured at a third location, and
• a fourth image of a third color, the fourth image captured at a fourth location which is co-planar with the first, second, and third locations;
• constructing a first disparity map using the plurality of image pixels by calculating pixel disparities between the first image and the second image via mono-chromatic stereo matching, the first disparity map being associated with a direction between the first and second locations;
• constructing a second disparity map, the second disparity map being associated with a direction between the first and third locations;
• warping the third image, using the second disparity map, to create a corrected third image;
• warping the fourth image, using the first and second disparity maps, to create a corrected fourth image;
• and
• combining the first image, the corrected third image, and the corrected fourth image to create a fused multi-channel color image.