Self-supervised single-view 3D reconstruction via semantic consistency
AssigneeNVIDIA Corporation
InventorsXueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Jan Kautz
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to identify a shape or camera pose of a three-dimensional object from a two-dimensional image of the object. In at least one embodiment, objects are identified in an image using one or more neural networks that have been trained on objects of a similar category and a three-dimensional mesh template.
Claims29
A method, comprising:
- using a neural network to generate a three-dimensional model of an object from a two-dimensional image;
- segmenting one or more parts of the object on the three-dimensional model to generate a canonical semantic map based, at least in part, on self-supervised co-part segmentation;
- and
- identifying the one or more parts of the object on the three-dimensional model using the canonical semantic map.
A system, comprising memory to store instructions that, as a result of execution by one or more processors, causes the system to:
- use a neural network to generate a three-dimensional model of an object from a two-dimensional image;
- segment one or more parts of the object on the three-dimensional model to generate a canonical semantic map based, at least in part, on self-supervised co-part segmentation;
- and
- identify the one or more parts of the object on the three-dimensional model using the canonical semantic map.
A non-transitory machine-readable medium having stored thereon a set of instructions, which if performed by one or more processors, cause the one or more processors to:
- use a neural network to generate a three-dimensional model of an object from a two-dimensional image;
- segment one or more parts of the object on the three-dimensional model to generate a canonical semantic map based, at least in part, on self-supervised co-part segmentation;
- and
- identify the one or more parts of the object on the three-dimensional model using the canonical semantic map.
Dependencies are inferred from the claim text.