# US 2026/0101026 A1 · High-quality three dimensional asset generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0101026 A1
- Document ID: US20260101026A1
- Status: Published application
- Kind: A1
- Application number: 19/170,298
- Filed: 2025-04-04
- Published: 2026-04-09
- Earliest claimed: 2024-10-07
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Chen-Hsuan Lin; Tsung-Yi Lin; Ming-Yu Liu; Xiaohui Zeng; Zhaoshuo Li; Zekun Hao; Donglai Xiang; Qianli Ma; Jingyi Jin; Fangyin Wei; Yin Cui
- Web page: https://patentgrep.com/patent/US20260101026A1

## CPC

- H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
- G06T 3/4046: using neural networks
- G06T 15/04: Texture mapping
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- H04N 13/156: Mixing image signals
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- G06T 2210/36: Level of detail
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the present disclosure provide systems and methods for generating a three-dimensional (3D) asset. A first multi-view diffusion model generates a multi-view image based on an input prompt. A second multi-view diffusion model generates a multi-view surface normal image based on the input prompt and the multi-view image. A 3D reconstruction engine processes the multi-view image and the multi-view surface normal image to generate an intermediate 3D representation of the object, including a polygon mesh and a low-resolution texture map. A rendering engine renders a second multi-view image based on the intermediate 3D representation. A third multi-view diffusion model processes the input prompt and the second multi-view image to generate a high-resolution multi-view image. The 3D reconstruction engine upscales the low-resolution texture map based on the high-resolution multi-view image and generates the 3D asset, which includes the polygon mesh and the upscaled texture map.

## Claims

### Claim 1

A system comprising:
processing circuitry to generate a three-dimensional (3D) asset using one or more neural networks, the processing circuitry being configured to implement:
a first multi-view diffusion model configured to receive and process an input prompt to generate a muti-view image of an object for which the 3D asset is to be generated;
a second multi-view diffusion model configured to receive and process the input prompt and the multi-view image to generate a multi-view surface normal image of the object;
a 3D reconstruction engine configured to receive and process the multi-view image and the multi-view surface normal image to generate an intermediate 3D representation of the object, wherein the intermediate 3D representation comprises a polygon mesh and a low-resolution texture map;
a rendering engine configured to render a second multi-view image based on the intermediate 3D representation of the object; and
a third multi-view diffusion model configured to receive and process the input prompt and the rendered second multi-view image to generate a high-resolution multi-view image; and
one or more memories to store parameters associated with the one or more neural networks,
wherein the 3D asset comprises the polygon mesh and a high-resolution texture map generated by upscaling, by the 3D reconstruction engine, the low-resolution texture map based on the high-resolution multi-view image.

### Claim 2 (depends on 1)

The system of claim 1, wherein the input prompt is text, an image, or both.

### Claim 3 (depends on 1)

The system of claim 1, wherein the multi-view surface normal image generated by the second multi-view diffusion model comprises surface normals of the object in the multi-view image, and wherein the second multi-view diffusion model is conditioned on both the multi-view image and the received prompt.

### Claim 4 (depends on 1)

The system of claim 1, wherein the 3D reconstruction engine configured to generate the intermediate 3D representation of the object, is further configured to:
generate a 3D neural representation of the object based on the multi-view image and the multi-view surface normal image; and
generate the polygon mesh and the low-resolution texture map based on the 3D neural representation of the object.

### Claim 5 (depends on 4)

The system of claim 4, wherein the 3D neural representation is generated based on a Transformer-based model.

### Claim 6 (depends on 4)

The system of claim 4, wherein the 3D reconstruction engine is further configured to generate a low-resolution material map based on the 3D neural representation of the object.

### Claim 7 (depends on 4)

The system of claim 4, wherein the low-resolution texture map and a low-resolution material map are mapped to the polygon mesh using a UV map.

### Claim 8 (depends on 7)

The system of claim 7, wherein the 3D reconstruction engine is further configured to:
extract a dense triangular mesh based on the 3D neural representation;
retopologize the dense triangular mesh to a simplified 3D quad mesh; and
generate the UV map based on the simplified 3D quad mesh and the 3D neural representation.

### Claim 9 (depends on 8)

The system of claim 8, wherein the UV map is generated by assigning each vertex of the simplified 3D quad mesh with a corresponding UV-coordinate in a 2D space of the UV map.

### Claim 10 (depends on 8)

The system of claim 8, wherein the 3D reconstruction engine extracts the dense triangular mesh from the 3D neural representation using a marching cubes algorithm.

### Claim 11

A method for generating a three-dimensional (3D) asset, the method comprising:
receiving and processing, using a first multi-view diffusion model, an input prompt to generate a muti-view image of an object for which the 3D asset is to be generated;
receiving and processing, using a second multi-view diffusion model, the input prompt and the multi-view image to generate a multi-view surface normal image of the object;
receiving and processing, using a 3D reconstruction engine, the multi-view image and the multi-view surface normal image to generate an intermediate 3D representation of the object, wherein the intermediate 3D representation comprises a polygon mesh and a low-resolution texture map;
rendering, using a rendering engine, a second multi-view image based on the intermediate 3D representation;
receiving and processing, using a third multi-view diffusion model the input prompt, the rendered second multi-view image, and the low-resolution texture map to generate a high-resolution multi-view image;
upscaling, using the 3D reconstruction engine, the low-resolution texture map based on the high-resolution multi-view image; and
providing the 3D asset, the 3D asset comprising the polygon mesh and the upscaled texture map.

### Claim 12 (depends on 11)

The method of claim 11, wherein the input prompt is text, an image, or both.

### Claim 13 (depends on 11)

The method of claim 11, wherein the multi-view surface normal image generated by the second multi-view diffusion model comprises surface normals of the object in the multi-view image, and wherein the second multi-view diffusion model is conditioned on both the multi-view image and the received input prompt.

### Claim 14 (depends on 11)

The method of claim 11, wherein the rendering engine is based on a Transformer-based model.

### Claim 15 (depends on 11)

The method of claim 11, wherein generating the intermediate 3D representation of the object comprises:
generating a 3D neural representation of the object based on the multi-view image and the multi-view surface normal image; and
generating the polygon mesh and the low-resolution texture map based on the 3D neural representation of the object.

### Claim 16 (depends on 15)

The method of claim 15, further comprising generating a low-resolution material map based on the 3D neural representation of the object.

### Claim 17 (depends on 11)

The method of claim 11, wherein the low-resolution texture map and a low-resolution material map are mapped to the polygon mesh using a UV map.

### Claim 18 (depends on 17)

The method of claim 17, wherein the polygon mesh generated by:
extracting a dense triangular mesh based on a 3D neural representation;
retopologizing the dense triangular mesh to a simplified 3D quad mesh; and generating the UV map based on the simplified 3D quad mesh and the 3D neural representation.

### Claim 19 (depends on 18)

The method of claim 18, wherein the UV map is generated by assigning each vertex of the simplified 3D quad mesh with a corresponding UV-coordinate in a 2D space of the UV map.

### Claim 20

A non-transitory computer-readable medium having stored thereon instructions that, when executed by processing circuitry, cause the processing circuitry to perform a method for generating a three-dimensional (3D) asset, the method comprising:
receiving and processing, using a first multi-view diffusion model, an input prompt to generate a muti-view image of an object for which the 3D asset is to be generated;
receiving and processing, using a second multi-view diffusion model, the input prompt and the multi-view image to generate a multi-view surface normal image of the object;
receiving and processing, using a 3D reconstruction engine, the multi-view image and the multi-view surface normal image to generate an intermediate 3D representation of the object, wherein the intermediate 3D representation comprises a polygon mesh and a low-resolution texture map;
rendering, using a rendering engine, a second multi-view image based on the intermediate 3D representation;
receiving and processing, using a third multi-view diffusion model the input prompt, the rendered second multi-view image, and the low-resolution texture map to generate a high-resolution multi-view image;
upscaling using the 3D reconstruction engine, the low-resolution texture map based on the high-resolution multi-view image; and
providing the 3D asset, the 3D asset comprising the polygon mesh and the upscaled texture map.

### Claim 21 (depends on 20)

The non-transitory computer-readable medium of claim 20, wherein generating the intermediate 3D representation of the object comprises:
generating a 3D neural representation of the object based on the multi-view image and the multi-view surface normal image; and
generating the polygon mesh and the low-resolution texture map based on the 3D neural representation of the object.

### Claim 22

A system comprising:
processing circuitry to generate a three-dimensional (3D) asset using one or more neural networks, the processing circuitry being configured to implement:
a first multi-view diffusion model configured to receive and process an input prompt to generate a muti-view image of an object for which the 3D asset is to be generated;
a second multi-view diffusion model configured to receive and process the input prompt and the multi-view image to generate a multi-view surface normal image of the object;
a 3D reconstruction engine configured to receive and process the multi-view image and the multi-view surface normal image to generate an 3D representation of the object, wherein the 3D representation comprises a polygon mesh and a texture map; and
one or more memories to store parameters associated with the one or more neural networks.

### Claim 23 (depends on 22)

The system of claim 22, wherein the 3D reconstruction engine configured to generate the 3D representation of the object, is further configured to:
generate a 3D neural representation of the object based on the multi-view image and the multi-view surface normal image; and
generate the polygon mesh and the texture map based on the 3D neural representation of the object.

### Claim 24 (depends on 23)

The system of claim 23, wherein the 3D reconstruction engine is further configured to generate a material map based on the 3D neural representation of the object.

### Claim 25 (depends on 24)

The system of claim 24, wherein the texture map and the material map are mapped to the polygon mesh using a UV map.

### Claim 26 (depends on 23)

The system of claim 23, wherein the 3D reconstruction engine is further configured to:
extract a dense triangular mesh based on the 3D neural representation;
retopologize the dense triangular mesh to a simplified 3D quad mesh; and
generate a UV map based on the simplified 3D quad mesh and the 3D neural representation.

### Claim 27

A system comprising:
processing circuitry to generate a three-dimensional (3D) asset using one or more neural networks, the processing circuitry being configured to implement:
a 3D reconstruction engine configured to receive and process a multi-view image and a multi-view surface normal image to generate an intermediate 3D representation, wherein the intermediate 3D representation comprises a polygon mesh and a low-resolution texture map;
a rendering engine configured to render a second multi-view image based on the intermediate 3D representation of the object; and
a third multi-view diffusion model configured to receive and process the input prompt and the rendered second multi-view image to generate a high-resolution multi-view image; and
one or more memories to store parameters associated with the one or more neural networks,
wherein the 3D asset comprises the polygon mesh and a high-resolution texture map generated by upscaling, by the 3D reconstruction engine, the low-resolution texture map based on the high-resolution multi-view image.

### Claim 28 (depends on 27)

The system of claim 27, wherein the multi-view surface normal image comprises surface normals of the object in the multi-view image.

### Claim 29 (depends on 27)

The system of claim 27, wherein the 3D reconstruction engine configured to generate the intermediate 3D representation, is further configured to:
generate a 3D neural representation based on the multi-view image and the multi-view surface normal image; and
generate the polygon mesh and the low-resolution texture map based on the 3D neural representation of the object.

### Claim 30 (depends on 29)

The system of claim 29, wherein the 3D reconstruction engine is further configured to:
extract a dense triangular mesh based on the 3D neural representation;
retopologize the dense triangular mesh to a simplified 3D quad mesh; and
generate the UV map, which maps the low-resolution texture map to the 3D quad mesh.
