Neural rendering for inverse graphics generation

A system, comprising:

• at least one processor;
• and
• memory including instructions that, when executed by the at least one processor, cause the system to:
• provide a two-dimensional image of an object as input to a generative network;
• generate, using the generative network, a set of view images of the object represented from different views;
• provide, as input to an inverse graphics network, the set of view images and information for the different views;
• determine, for individual view images of the set using the inverse graphics network, a set of three-dimensional information;
• render, for the individual view images of the set, a representation of the object using the set of three-dimensional information and the respective view information;
• compare the rendered representations against corresponding data to determine at least one loss value;
• and
• adjust one or more network parameters for the inverse graphics network based at least in part upon the at least one loss value.

A computer-implemented method, comprising:

• receiving a two-dimensional image;
• and
• generating a three-dimensional representation of the two-dimensional image using an inverse graphics network, the inverse graphics network trained at least in part by:
• generating, using a generative network and a two-dimensional input image of an object, a set of view images of the object represented from different views;
• determining, for individual view images of the set using the inverse graphics network, a set of three-dimensional information;
• rendering, for the individual view images of the set, a representation of the object using the set of three-dimensional information and information for the respective view;
• comparing the rendered representations against corresponding representations to determine at least one loss value;
• and
• adjusting one or more network parameters for the inverse graphics network based at least in part upon the at least one loss value.