Back to results
US 2015/0091900 A1Published application
Systems and Methods for Depth-Assisted Perspective Distortion Correction
AssigneePelican Imaging Corporation
InventorsSamuel Yang, Manohar Srikanth, Dan Lelescu, Kartik Venkataraman
Life of this patent
Estimating the term…
Abstract
Systems and methods for automatically correcting apparent distortions in close range photographs that are captured using an imaging system capable of capturing images and depth maps are disclosed. In many embodiments, faces are automatically detected and segmented from images using a depth-assisted alpha matting. The detected faces can then be re-rendered from a more distant viewpoint and composited with the background to create a new image in which apparent perspective distortion is reduced.
Claims15
An image processing system, comprising:
- a processor;
- memory containing an image processing application, and image data for an image captured from an initial viewpoint and depth map data indicating distances to objects within the scene from the initial viewpoint;
- wherein the image processing application stored in the memory directs the processor to:
- detect an object within the image data and a distance from the initial viewpoint to the object from the depth map data;
- segment object image data from background image data using the depth map data;
- rerender the object from a synthetic viewpoint by warping the segmented object image data based upon the depth map data to generate warped object image data, where the synthetic viewpoint is a greater distance from the object relative to the distance from the initial viewpoint to the object;
- and
- combine the warped object image data with the background image data to create perspective distortion corrected image data.
5 more elements
An image processing system, comprising:
- a processor;
- memory containing an image processing application, and image data for an image captured from an initial viewpoint and depth map data indicating distances to objects within the scene from the initial viewpoint;
- wherein the image processing application stored in the memory directs the processor to:
- detect a face within the image data and a distance from the initial viewpoint to the face from the depth map data;
- segment face image data from background image data using the depth map data by:
- identifying a trimap for the image data using the image data and the depth map data;
- and
- generating an alpha matte using the trimap;
- rerender the face from a synthetic viewpoint by warping the segmented face image data based upon the depth map data to generate warped face image data, where the synthetic viewpoint is a greater distance from the face relative to the distance from the initial viewpoint to the face by:
- selecting a desired viewpoint distance;
- projecting the segmented object image data to 3D locations based upon distances to pixels within the segmented object image data contained within the depth map data;
- re-projecting the 3D locations to new 2D pixel locations based upon the desired viewpoint distance to create warped object image data;
- and
- filling holes in the warped object image data;
- inpaint the background image data;
- and
- combine the warped face image data with the background image data to create perspective distortion corrected image data.
14 more elements
Dependencies are inferred from the claim text.