US 2014/0232822 A1Published application

Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information

AssigneePelican Imaging Corporation

InventorsKartik Venkataraman, Dan Lelescu, Gabriel Molina

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.

Claims22

Dependent claims

An array camera, comprising:

a processor;
and
a memory connected to the processor and configured to store an image processing application;
wherein the image processing application configures the processor to:
obtain image data, wherein:
the image data comprises a set of images comprising a reference image and at least one alternate view image;
and
each image in the set of images comprises a set of pixels;
generate a depth map based on the image data, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image;
determine at least one prediction image based on the reference image and the depth map, where the prediction images correspond to at least one alternate view image;
compute prediction error data based on the at least one prediction image and the at least one alternate view image, where a portion of prediction error data describes the difference in photometric information between a pixel in a prediction image and a pixel in at least one alternate view image corresponding to the prediction image;
and
generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.

10 more elements

A method for generating compressed light field representation data, comprising:

obtaining image data using an array camera, where the image data comprises a set of images comprising a reference image and at least one alternate view image and the images in the set of images comprise a set of pixels;
generating a depth map based on the image data using the array camera, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image based on the alternate view images;
determining a set of prediction images based on the reference image and the depth map using the array camera, where a prediction image in the set of prediction images is a representation of a corresponding alternate view image in the at least one alternate view image;
computing prediction error data by calculating the difference between a prediction image in the set of prediction images and the corresponding alternate view image that describes the difference in photometric information between a pixel in the reference image and a pixel in an alternate view image using the array camera;
and
generating compressed light field representation data based on the reference image, the prediction error data, and the depth map using the array camera.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/186,871Filed 21 Feb 2014
Priority: 21 Feb 2013
Published: 21 Aug 2014
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06T 7/60
Image analysis: analysis of geometric attributes
G06T 7/50
Image analysis: depth or shape recovery
H04N 23/64
Control of cameras or camera modules: computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality,…
H04N 23/95
Cameras or camera modules comprising electronic image sensors; Control thereof: computational photography systems, e.g. light-field imaging systems