3d asset generation from 2d images

A system, comprising:

• a memory with instructions stored thereon;
• and
• a processing device, coupled to the memory, the processing device configured to access the memory, wherein the instructions when executed by the processing device, cause the processing device to perform operations including:
• obtaining a two-dimensional (2D) image of an object;
• obtaining a template three-dimensional (3D) mesh and a representative of a class of objects of interest that includes the object;
• generating, using a trained machine learning model and based on the template 3D mesh and the representative of the class, a rigged 3D mesh for the object;
• deforming the rigged 3D mesh to match the 2D image;
• and
• applying a texture extracted from the 2D image to the deformed and posed 3D mesh to create the 3D asset.

A non-transitory computer-readable medium comprising instructions that, responsive to execution by a processing device, causes the processing device to perform operations comprising:

• providing a two-dimensional (2D) image of an object as input to a trained machine learning model;
• obtaining a template three-dimensional (3D) mesh and a representative of a class of objects of interest that includes the object;
• generating, using the trained machine learning model, based on the template 3D mesh and the representative of the class, a rigged 3D mesh for the object;
• deforming and posing the rigged 3D mesh to match the 2D image;
• and
• applying a texture extracted from the 2D image to the deformed and posed 3D mesh to create the 3D asset of the object.