Computational Camera Using Fusion of Image Sensors

A method, comprising:

• capturing light of an image as both a Bayer image and a clear image in monochrome;
• demosaicing the Bayer image to generate an initial color image;
• generating a disparity map to establish correspondence between color image pixels of the initial color image and clear image pixels of the clear image;
• generating a mapped color image based on the disparity map to map the initial color image onto the clear image;
• denoising the clear image to generate a denoised clear image;
• applying the denoised clear image as a guide image of a guided filter that filters the mapped color image to generate a filtered color image;
• and
• fusing the filtered color image and the denoised clear image to produce an enhanced, high-resolution HDR color image.

A portable device, comprising:

• a camera device configured to capture light of an image as both a Bayer image and a clear image in monochrome;
• one or more computer processors;
• and
• one or more computer-readable storage media having executable instructions thereon that, in response to execution by the one or more computer processors, perform operations comprising:
• performing a demosaicing algorithm to generate an initial color image from the Bayer image;
• performing a dynamic shifts algorithm to generate a disparity map that establishes correspondence between color image pixels of the initial color image and clear image pixels of the clear image;
• performing a mapping algorithm to generate a mapped color image based on the disparity map to map the initial color image onto the clear image;
• performing a fusion algorithm to apply a denoised clear image as a guide image of a guided filter that filters the mapped color image to generate a filtered color image, and fuse the filtered color image and the denoised clear image to produce an enhanced, high-resolution HDR color image;
• and
• performing the dynamic shifts algorithm to update the disparity map based on the enhanced, high-resolution HDR color image.