Realistic augmentation of images and videos with graphics
AssigneeAdobe Systems Incorporated
InventorsShabbir Marzban, Brunno Fidel Maciel Attorre, Nicolas Huynh Thien
Life of this patent
Estimating the term…
Abstract
Techniques disclosed herein relate generally to augmenting images or videos with graphics. More specifically, some embodiments relate to realistically or photorealistically augmenting a target image or video frame with a source graph, such as a computer-generated graph or a real world image. In one embodiment, a planar segment of the target image is identified based on a surface normal map of the target image. The planar segment is then used to determine a focal length and a homography function for transforming the source graph.
Claims20
A computer-implemented method comprising, by one or more computing systems:
- receiving a target image;
- identifying a planar region in the target image;
- identifying a plurality of line segments for the planar region of the target image, wherein the plurality of line segments are not parallel;
- determining parameters for a homography function based on an inverse function of the homography function, wherein the inverse function of the homography function transforms at least two line segments from the plurality of line segments into two line segments in a front-parallel view, the two line segments in the front-parallel view forming a predetermined angle;
- obtaining a source image in the front-parallel view;
- transforming the source image using the homography function;
- and
- superimposing the transformed source image onto the planar region of the target image.
A system comprising:
- a processing device;
- and
- a non-transitory computer-readable medium communicatively coupled to the processing device, wherein the processing device is configured to execute program code stored in the non-transitory computer-readable medium and thereby perform operations comprising:
- receiving a target image;
- identifying a planar region in the target image;
- identifying a plurality of line segments for the planar region of the target image, wherein the plurality of line segments are not parallel;
- determining parameters for a homography function based on an inverse function of the homography function, wherein the inverse function of the homography function transforms at least two line segments from the plurality of line segments into two line segments in a front-parallel view, the two line segments in the front-parallel view forming a predetermined angle;
- obtaining a source image in the front-parallel view;
- transforming the source image using the homography function;
- and
- superimposing the transformed source image onto the planar region of the target image.
A system for augmenting images or videos, the system comprising:
- means for receiving a target image;
- means for identifying a planar region in the target image;
- means for identifying a plurality of line segments for the planar region of the target image, wherein the plurality of line segments are not parallel;
- means for determining parameters for a homography function based on an inverse function of the homography function, wherein the inverse function of the homography function transforms at least two line segments from the plurality of line segments into two line segments in a front-parallel view, the two line segments in the front-parallel view forming a predetermined angle;
- means for obtaining a source image in the front-parallel view;
- means for transforming the source image using the homography function;
- and
- means for superimposing the transformed source image onto the planar region of the target image.
Dependencies are inferred from the claim text.