Systems and methods for reconstructing body shape and pose

A system for reconstructing representations of bodies from images, comprising:

• one or more processors;
• and
• one or more memory devices storing computer-readable instructions that, when implemented, cause the one or more processors to perform operations, the operations comprising:
• inputting, into a machine-learned reconstruction model, input data descriptive of an image depicting a body;
• predicting, using a machine-learned marker prediction component of the reconstruction model, a set of surface marker locations on the body;
• and
• outputting, using a machine-learned marker poser component of the reconstruction model, an output representation of the body that corresponds to the set of surface marker locations;
• wherein one or more parameters of the reconstruction model were learned at least in part based on a consistency loss corresponding to a distance between (i) a relaxed-constraint representation generated from a prior set of surface marker locations predicted according to the one or more parameters and (ii) a parametric representation generated from the prior set using kinematic constraints associated with the body.

A system for reconstructing representations of bodies from images, comprising:

• one or more processors;
• and
• one or more memory devices storing computer-readable instructions that, when implemented, cause the one or more processors to perform operations, the operations comprising:
• inputting, into a machine-learned marker prediction model, input data descriptive of an image depicting a body;
• predicting, using the marker prediction model, a set of surface marker locations on the body;
• outputting, using a machine-learned marker poser model, a parametric representation of the body that corresponds to the set of surface marker locations;
• and
• updating one or more parameters of the marker prediction model based at least in part on a consistency loss corresponding to a distance between the parametric representation and a relaxed-constraint representation associated with the predicted set of surface marker locations.