Methods and apparatus for calibrating focused plenoptic camera data

A system, comprising

• one or more processors;
• and
• a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to:
• obtain a radiance image comprising a plurality of separate microimages of an image of a scene, the radiance image having a spatial resolution that is a function of a resolution of said microimages and an amount of overlap in rendering of said microimages, and not of a number of microlenses used to capture said microimages;
• display the radiance image in a first portion of a user interface and a control area in a second portion of the user interface, the control area including one or more user interface elements that are user-selectable to adjust respective parameters of the radiance image;
• apply a calibration technique to the radiance image to generate a transformation matrix for the radiance image without modifying the radiance image, the calibration technique being based on an adjusted value of the one or more user interface elements;
• and
• perform a radiance processing technique on the radiance image to render an output image, at least a portion of the radiance processing technique being performed by a fragment shader on one or more graphics processing units (GPUs), the radiance processing technique including at least:
• application of the transformation matrix to the radiance image, prior to texture lookups in the fragment shader, to transform the plurality of separate microimages according to the transformation matrix;
• and
• a rendering of the output image from the transformed microimages.

A computer-readable storage memory storing program instructions, wherein the program instructions are computer-executable to implement:

• obtaining a radiance image comprising a plurality of separate microimages of an image of a scene, the radiance image having a spatial resolution that is a function of a resolution of said microimages and an amount of overlap in rendering of said microimages;
• displaying, via a user interface having at least a first portion and a second portion, the radiance image in the first portion and a control area in the second portion, the control area including multiple user interface elements that are user-selectable to adjust respective parameters of the radiance image;
• applying a calibration technique to the radiance image to generate a transformation matrix for the radiance image without modifying the radiance image, the calibration technique being based on an adjusted value of one or more of the multiple user interface elements;
• and
• performing a radiance processing technique on the radiance image to render an output image, at least a portion of the radiance processing technique being performed by a fragment shader on one or more graphics processing units (GPUs), the radiance processing technique being performed by at least:
• applying the transformation matrix to the radiance image to transform the plurality of separate microimages according to the transformation matrix, the transformation matrix being applied to the radiance image before texture look-ups in the fragment shader to allow shaders to be generated that assume calibrated images;
• and
• rendering the output image from the transformed microimages.