Automatically generating synthetic images from novel viewpoints

A computing system implemented using a server system, the computing system configured to cause:

• processing a plurality of captured images of an object and a background, each captured image captured from a viewpoint with a designated angle with respect to the object;
• generating, based on the captured images, three-dimensional representations of the background and the object;
• rendering, using the three-dimensional representations, a synthetic image of the object and the background, the synthetic image depicting a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images;
• generating, based on the rendered synthetic image, a corrected synthetic image;
• storing the corrected synthetic image on a storage medium;
• and
• using the corrected synthetic image as training data for a machine learning model.

One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:

• processing a plurality of captured images of an object and a background, each captured image captured from a viewpoint with a designated angle with respect to the object;
• generating, based on the captured images, three-dimensional representations of the background and the object;
• rendering, using the three-dimensional representations, a synthetic image of the object and the background, the synthetic image depicting a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images;
• generating, based on the rendered synthetic image, a corrected synthetic image;
• storing the corrected synthetic image on a storage medium;
• and
• causing the corrected synthetic image to be used as training data for a machine learning model.