Array camera configurations incorporating constituent array cameras and constituent cameras
AssigneePelican Imaging Corporation
InventorsKartik Venkataraman, Jacques Duparré
Life of this patent
Estimating the term…
Abstract
Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.
Claims23
An array camera configuration, comprising:
- a constituent array camera comprising a plurality of cameras, where each camera comprises:
- optics that form an image on a focal plane defined by an array of pixels that capture image data;
- and have fields of view that form a combined field of view in a first viewing direction;
- a separate camera comprising:
- optics that form an image on a focal plane defined by an array of pixels that capture image data;
- and having a field of view in a second viewing direction;
- a processor;
- memory containing an image processing application and calibrated warp data;
- wherein the image processing application directs the processor to:
- obtain image data from the cameras in the constituent array camera;
- capture an image using the separate camera from a viewpoint;
- generate a depth map using the image data captured by the constituent array camera;
- synthesize an image using the image data captured by the constituent array camera and the depth map;
- and
- construct an enhanced image using the image captured by the separate camera, the synthesized image, and the depth map used to synthesize the synthesized image by:
- warping the synthesized image into the viewpoint of the image captured by the separate camera using the calibrated warp data and the depth map;
- and
- blending the synthesized image warped into the viewpoint of the image captured by the separate camera and the image captured by the separate camera to create the enhanced image.
Dependencies are inferred from the claim text.