Resilient Image Capture System and Method of Use Thereof
OwnerClement Shimizu, D'nardo Colucci +2inventors
InventorsClement Shimizu, D'nardo Colucci, Clayton Hooker, Marco Silva
Life of this patent
Estimating the term…
Abstract
A resilient image capture system and method of use is described. Embodiments of the system can be implemented to calibrate a display device in non-ideal lighting environment. The system can implement one or more methods to aid in calibrating the display device in the non-ideal lighting environment. A first method can be implemented to map UV coordinates between a display device and a camera.
Claims20
A display device-camera calibration pipeline including at least one method, the pipeline including a first method for mapping display device UV coordinates to camera UV coordinates in non-ideal lighting conditions, the first method comprising:
- displaying a first set of horizontal wavelet patterns by a display device;
- capturing a first image, the first image of the first set of horizontal wavelet patterns by a camera;
- displaying an inverted version of the first set of horizontal wavelet patterns by the display device;
- capturing a second image, the second image of the inverted version of the first set of horizontal wavelet patterns by the camera;
- computing a first difference image by subtracting the second image from the first image by a control module;
- displaying a first set of vertical wavelet patterns by the display device;
- capturing a third image, the third image of the first set of vertical wavelet patterns by the camera;
- displaying an inverted version of the first set of vertical wavelet patterns by the display device;
- capturing a fourth image, the fourth image of the inverted version of the first set of vertical wavelet patterns by the camera;
- computing a second difference image by subtracting the fourth image from the third image by the control module;
- applying a threshold to the first difference image and the second difference image to classify pixels in each image as white or black;
- and
- combining the pixel classifications to determine a display device-to-camera mapping.
A display device-camera calibration pipeline including two or more methods, the pipeline including a first method for mapping display device UV coordinates to camera UV coordinates, the first method comprising:
- providing a display device, a camera, and a control module;
- displaying a plurality of wavelet patterns one at a time, the plurality of wavelet patterns corresponding to horizontally oriented frequency bands and vertically oriented frequency bands of the display device;
- capturing a positive image and an inverted image for each wavelet pattern of the plurality of wavelet patterns;
- computing a plurality of difference images by subtracting an inverted image from a positive image for each wavelet pattern of the plurality of wavelet patterns;
- applying a threshold to the plurality of difference images about zero to classify pixels as representing a white region, a black region, or an invalid region;
- and
- combining classification results for each of the plurality of difference images to identify pairs of display device UV coordinates and corresponding camera UV coordinates.
A display device-camera calibration pipeline including at least three methods, a first method implemented for mapping display device UV coordinates to camera UV coordinates, a second method for a camera having auto-exposure, and a third method for transmitting and reconstructing a signal to reduce edge artifacts, the first method comprising:
- providing at least one display device, at least one camera, and a control module;
- by the at least one display device:
- displaying a plurality of wavelet patterns one at a time, the plurality of wavelet patterns corresponding to horizontally oriented frequency bands and vertically oriented frequency bands of the display device;
- by the at least one camera:
- capturing a positive image and an inverted image for each wavelet pattern of the plurality of wavelet patterns;
- by the control module:
- computing a plurality of difference images by subtracting a negative image from a positive image for each wavelet pattern of the plurality of wavelet patterns;
- applying a threshold to the plurality of difference images about zero to classify pixels as representing a white region, a black region, or an invalid region;
- and
- combining classification results for each of the plurality of difference images to identify pairs of display device UV coordinates and corresponding camera UV coordinates.
Dependencies are inferred from the claim text.