Method and apparatus for managing artifacts in frequency domain processing of light-field images
AssigneeAdobe Systems Incorporated
InventorsChintan Intwala, Todor G. Georgiev
Life of this patent
Estimating the term…
Abstract
Various methods and apparatus for removing artifacts in frequency domain processing of light-field images are described. Methods for the reduction or removal of the artifacts are described that include methods that may be applied during frequency domain processing and a method that may be applied during post-processing of resultant angular views. The methods may be implemented in software as or in a light-field frequency domain processing module. The described methods include an oversampling method to determine the correct centers of slices, a phase multiplication method to determine the correct centers of slices, a method to exclude low-energy slices, and a cosmetic correction method.
Claims27
A computer-implemented method, comprising:
- processing a light-field image in the frequency domain to render multiple angular views of a scene, wherein, said processing comprises:
- extracting multiple slices from a Fourier transform of the light-field image;
- and
- rendering the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;
- wherein said processing further comprises applying a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;
- wherein said oversampling technique comprises generating the Fourier transform as an oversampled Fourier transform of the light-field image and determining the subpixel centers from the slices extracted from the oversampled Fourier transform;
- and
- wherein said phase multiplication technique comprises iteratively applying phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice.
A system, comprising:
- at least one processor;
- and
- a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to process a light-field image in the frequency domain to render multiple angular views of a scene, wherein, to process the light-field image, the program instructions are executable by the at least one processor to:
- extract multiple slices from a Fourier transform of the light-field image;
- and
- render the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;
- wherein, to process the light-field image, the program instructions are further executable by the at least one processor to apply a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;
- wherein said oversampling technique generates the Fourier transform as an oversampled Fourier transform of the light-field image and determines the subpixel centers from the slices extracted from the oversampled Fourier transform;
- and
- wherein said phase multiplication technique iteratively applies phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice.
A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement:
- processing a light-field image in the frequency domain to render multiple angular views of a scene, wherein, in said processing, the program instructions are computer-executable to implement:
- extracting multiple slices from a Fourier transform of the light-field image;
- and
- rendering the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;
- wherein, in said processing, the program instructions are further computer-executable to implement applying a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;
- wherein said oversampling technique generates the Fourier transform as an oversampled Fourier transform of the light-field image and determines the subpixel centers from the slices extracted from the oversampled Fourier transform;
- and
- wherein said phase multiplication technique iteratively applies phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice.
Dependencies are inferred from the claim text.