US 12,725,344 B2 · AI-assisted texture generation

Abstract

An AI-assisted texture generation system and method that generates a texture for an object such as a 3D mesh. At a given iteration, the system renders, from a viewpoint, one or more of an object depth and a cumulative texture associated with a cumulative pixel quality map; determines an estimated pixel quality map associated with the viewpoint; generates, at the viewpoint, a new texture associated with the object based on one or more of the object depth, the cumulative texture, and a refine mask; updates the cumulative texture based on the new texture; and updates the cumulative pixel quality map based on the estimated pixel quality map. In some examples, the refine mask is computed based on the cumulative pixel quality map and an estimated pixel quality map. In some examples, the new texture is generating using an augmented inpainting diffusion model for image generation.

Claims18

Dependent claims

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

rendering, at a viewpoint, one or more of an object depth and a cumulative texture associated with a cumulative pixel quality map;
determining an estimated pixel quality map associated with the viewpoint, wherein the estimated pixel quality map associated with the viewpoint is computed based on one or more of position data associated with the viewpoint, a cumulative texture resolution, a new texture resolution, and a mapping from a view space associated with generating the new texture to a texture space associated with the cumulative texture;
generating, at the viewpoint, a new texture associated with an object based on one or more of the object depth, the cumulative texture, and a refine mask;
updating the cumulative texture based on the new texture;
and
updating the cumulative pixel quality map based on the estimated pixel quality map.

3 more elements

A method comprising:

rendering, at a viewpoint, one or more of an object depth and a cumulative texture associated with a cumulative pixel quality map;
determining an estimated pixel quality map associated with the viewpoint, wherein the estimated pixel quality map associated with the viewpoint is computed based on one or more of position data associated with the viewpoint, a cumulative texture resolution, a new texture resolution, and a mapping from a view space associated with generating the new texture to a texture space associated with the cumulative texture;
generating, at the viewpoint, a new texture associated with an object based on one or more of the object depth, the cumulative texture, and a refine mask;
updating the cumulative texture based on the new texture;
and
updating the cumulative pixel quality map based on the estimated pixel quality map.

3 more elements

Dependencies are inferred from the claim text.

AI-assisted texture generation

Life of this patent

AI-assisted texture generation

Life of this patent

Abstract

Claims18