View synthesis with spatial and rotational consistency
AssigneeAdobe Inc.
InventorsStefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang, YoungJoong Kwon
Life of this patent
Estimating the term…
Loading patent…
AssigneeAdobe Inc.
InventorsStefano Petrangeli, Viswanathan Swaminathan, Haoliang Wang, YoungJoong Kwon
Estimating the term…
Methods, system, and computer storage media are provided for novel view synthesis. An input image depicting an object is received and utilized to generate, via a neural network, a target view image. In exemplary aspects, additional view images are also generated within the same pass of the neural network. A loss is determined based on the target view image and additional view images and is used to modify the neural network to reduce errors. In some aspects, a rotated view image is generated by warping a ground truth image from an initial angle to a rotated view angle that matches a view angle of an image synthesized via the neural network, such as a target view image. The rotated view image and the synthesized image matching the rotated view angle (e.g., a target view image) are utilized to compute a rotational loss.
A computer-implemented method for novel view synthesis, the method comprising:
One or more computer storage media having a plurality of executable instructions embodied thereon, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
A computerized method for novel view synthesis, the computerized method comprising:
Dependencies are inferred from the claim text.