Automatic retopologization of textured 3D meshes

A method for automating the retopologization of 3D meshes, comprising:

• generating an input scan mesh associated with an object;
• generating an intermediate mesh associated with the object that has a geometry that approximates the input scan mesh;
• identifying a keypoint on the intermediate mesh;
• determining a threshold distance based on a degree of certainty associated with the keypoint;
• determining a first surface normal associated with the keypoint and a second surface normal associated with the candidate correspondence point;
• displacing the keypoint in the direction of the first surface normal by the threshold distance;
• calculating a matching score based on a distance between the keypoint and a candidate correspondence point on the input scan mesh, the first surface normal, and the second surface normal;
• selecting the candidate correspondence point based on the matching score;
• and
• adjusting the intermediate mesh using the candidate correspondence point.

A system for automating the retopologization of 3D meshes, comprising:

• a storage device configured to store a source 3D mesh;
• and
• a processing system in communication with the storage device that is configured to:
• generate a target 3D mesh that has a geometry that approximates the source 3D mesh;
• identify a keypoint on the target 3D mesh;
• determine a threshold distance based on a degree of certainty associated with the keypoint;
• determine a first surface normal associated with the keypoint and a second surface normal associated with the candidate correspondence point;
• determine a difference in surface curvature for a first surface associated with the keypoint and a second surface associated with the candidate correspondence point;
• displace the keypoint in the direction of the first surface normal by the threshold distance;
• calculate a matching score based on a distance between the keypoint and a candidate correspondence point on the source 3D mesh, a difference between the first surface normal and the second surface normal, and the difference in surface curvature;
• select the candidate correspondence point based on the matching score;
• warp the target 3D mesh using the candidate correspondence point;
• and
• apply photometric refinement to the target 3D mesh subsequent to warping the target 3D mesh.