Generation and use of a 3d radon image
AssigneeQUALCOMM Incorporated
InventorsTodor Georgiev Georgiev, Salil Tambe
Life of this patent
Estimating the term…
Abstract
Certain aspects relate to systems and techniques for efficiently recording captured plenoptic image data and for rendering images from the captured plenoptic data. The plenoptic image data can be captured by a plenoptic or other light field camera. In some implementations, four dimensional radiance data can be transformed into three dimensional data by performing a Radon transform to define the image by planes instead of rays. A resulting Radon image can represent the summed values of energy over each plane. The original three-dimensional luminous density of the scene can be recovered, for example, by performing an inverse Radon transform. Images from different views and/or having different focus can be rendered from the luminous density.
Claims30
A system in an electronic device for rendering a final image, the system comprising:
- a plenoptic camera including a microlens array and an image sensor, the plenoptic camera configured to capture plenoptic image data of an image scene;
- and
- one or more processors in data communication with the plenoptic camera and configured to at least:
- receive the captured plenoptic image data, the captured plenoptic image data including a plurality of microimages each formed by one of a plurality of microlenses in the microlens array focusing light from the image scene onto the image sensor,
- determine a plurality of lines of integration located within a plane bisecting the microlens array, each of the plurality of lines of integration corresponding to a plane extending through three dimensional space of the image scene, and
- generate a Radon image based at least partly on a plurality of pixels of the plenoptic image data corresponding to the plurality of lines of integration.
A system in an electronic device for rendering a final image, the system comprising:
- a first module configured to at least access data representing a Radon image, the Radon image representing, for each sampled plane of a plurality of sampled planes of an image scene, a sum of light energy in the sampled plane;
- a second module configured to at least determine a luminous density of the image scene based at least partly on integrating the sum of light energy from each sampled plane of the plurality of sampled planes of the Radon image;
- and
- a third module configured to at least project the luminous density onto an image plane to produce the final image.
A method for compressing plenoptic image data, the method comprising:
- receiving at least a portion of data representing a plenoptic image of a three-dimensional image space from a plenoptic camera having a microlens array and an image sensor;
- identifying a plane of integration intersecting a microlens plane, the microlens plane bisecting the microlens array;
- determining an image line intersecting the plane of integration and an image plane located a first distance from the microlens plane;
- determining a microlens line intersecting the plane of integration and the microlens plane;
- mapping the image line to a microimage based at least partly on intersection of microlens line and the microlens, the microimage formed on the image sensor by a microlens of the microlens array;
- and
- summing pixel values for each of a plurality of pixels in the microimage, the plurality of pixels located along the image line mapped to the microimage.
A non-transitory, computer-readable medium storing instructions that, when executed, cause one or more computing devices to perform operations comprising:
- receiving Radon image data of an image scene, the Radon image data representing a luminous density of the image scene as summed values of light energy in each of a plurality of planes of the image scene;
- computing an intermediate function of the Radon image using a back-projection of the Radon image;
- recovering the luminous density of the image scene based at least partly on the intermediate function of the Radon image;
- and
- projecting the luminous density onto an image plane to produce a dynamically refocusable rendered image of the image scene.
Dependencies are inferred from the claim text.