3d garment generation from 2d scribble images

A system that generates a three-dimensional (3D) garment image from a two-dimensional (2D) garment image drawn by a user, comprising:

• a conditional 2D generator that receives the 2D garment image drawn by the user and generates color-density pairs from the 2D garment image;
• a density aware sampling algorithm that conducts density-aware sampling of the color-density pairs to generate a flat point cloud;
• and
• a diffusion-based generator that generates an output 3D point cloud from the flat point cloud by adding noise to a depth dimension in a forward diffusion process, initializing depth with a Gaussian distribution, and updating the depth gradually in a backward denoising process and outputs the 3D point cloud for display as the 3D garment image.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a processor cause the processor to generate a three-dimensional (3D) garment image from a two-dimensional (2D) garment image drawn by a user by performing operations comprising:

• receiving the 2D garment image drawn by the user;
• generating, by a conditional 2D generator, color-density pairs from the 2D garment image;
• conducting density-aware sampling of the color-density pairs to generate a flat point cloud;
• generating, by a diffusion-based generator, an output 3D point cloud from the flat point cloud into by adding noise to a depth dimension in a forward diffusion process, initializing depth with a Gaussian distribution, and updating the depth gradually in a backward denoising process;
• and
• sending the output 3D point cloud for display as the 3D garment image.