Systems and methods for generating a splat representation of a three-dimensional asset without an iterative rendering phase

A splat generation system comprising:

• one or more hardware processors configured to:
• receive a three-dimensional (3D) asset that is defined with a plurality of 3D primitives;
• generate a splat representation of the 3D asset, wherein the splat representation is defined with a plurality of splats;
• compare geometric similarity between different sets of splats from the plurality of splats in different regions of the splat representation and different sets of 3D primitives from the plurality of 3D primitives in corresponding regions of the 3D asset over a first set of training iterations that do not adjust colors associated with the plurality of splats;
• adjust a position or a geometry of a set of splats from the different sets of splats without adjusting the colors associated with the set of splats at each training iteration of the first set of training iterations in response to the geometric similarity between the set of splats and a set of 3D primitives from the different sets of 3D primitives in a region of the 3D asset that corresponds to a region with the set of splats in the splat representation not satisfying a threshold;
• reconstruct the 3D asset with an acceptable amount of geometric loss with the splat representation based on said adjusting of the set of splats across the first set of training iterations;
• and
• perform a color adjustment iteration after the first set of training iterations, wherein performing the color adjustment iteration comprises adjusting the colors of the set of splats to match colors of corresponding 3D primitives from the set of 3D primitives with an acceptable amount of color loss.

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a splat generation system, cause the splat generation system to perform operations comprising:

• receiving a three-dimensional (3D) asset that is defined with a plurality of 3D primitives;
• generating a splat representation of the 3D asset, wherein the splat representation is defined with a plurality of splats;
• comparing geometric similarity between different sets of splats from the plurality of splats in different regions of the splat representation and different sets of 3D primitives from the plurality of 3D primitives in corresponding regions of the 3D asset over a first set of training iterations that do not adjust colors associated with the plurality of splats;
• adjusting a position or a geometry of a set of splats from the different sets of splats without adjusting the colors associated with the set of splats at each training iteration of the first set of training iterations in response to the geometric similarity between the set of splats and a set of 3D primitives from the different sets of 3D primitives in a region of the 3D asset that corresponds to a region with the set of splats in the splat representation not satisfying a threshold;
• reconstructing the 3D asset with an acceptable amount of geometric loss with the splat representation based on said adjusting of the set of splats across the first set of training iterations;
• and
• performing a color adjustment iteration after the first set of training iterations, wherein performing the color adjustment iteration comprises adjusting the colors of the set of splats to match colors of corresponding 3D primitives from the set of 3D primitives with an acceptable amount of color loss.