# US 2026/0030837 A1 · Machine learning-based generation of three-dimensional representations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0030837 A1
- Document ID: US20260030837A1
- Status: Published application
- Kind: A1
- Application number: 18/780,747
- Filed: 2024-07-23
- Published: 2026-01-29
- Earliest claimed: 2024-07-23
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Zijia Wang; Junyi Wu; Tianlu Fei; Bin He; Zhenzhen Lin; Zhen Jia
- Web page: https://patentgrep.com/patent/US20260030837A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06N 20/00: Machine learning
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An apparatus comprises at least one processing device configured to extract a set of features from a user prompt using a natural language processing model, to initialize a three-dimensional scene reconstruction model utilizing a set of parameters determined based at least in part on the set of features extracted from the user prompt, and to generate, utilizing the three-dimensional scene reconstruction model, a set of two-dimensional images of a given scene from two or more different viewpoint perspectives. The at least one processing device is also configured to apply an image diffusion model to the generated set of two-dimensional images to generate a refined set of two-dimensional images, to modify the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images, and to utilize the modified three-dimensional scene reconstruction model to generate a three-dimensional representation of the given scene.

## Claims

### Claim 1

An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to extract a set of features from a user prompt using a natural language processing model;
to initialize a three-dimensional scene reconstruction model utilizing a set of parameters determined based at least in part on the set of features extracted from the user prompt;
to generate, utilizing the three-dimensional scene reconstruction model, a set of two-dimensional images of a given scene from two or more different viewpoint perspectives;
to apply an image diffusion model to the generated set of two-dimensional images to generate a refined set of two-dimensional images;
to modify the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images; and
to utilize the modified three-dimensional scene reconstruction model to generate a three-dimensional representation of the given scene.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the three-dimensional scene reconstruction model comprises a Neural Radiance Field (NeRF) model configured to take as input a three-dimensional position vector and a two-dimensional viewing direction and output a color and density at each of two or more points of the given scene.

### Claim 3 (depends on 2)

The apparatus of claim 2 wherein initializing the three-dimensional scene reconstruction model comprises initializing weights of a neural network that represents a neural radiance field.

### Claim 4 (depends on 1)

The apparatus of claim 1 wherein generating the set of two-dimensional images of the given scene from two or more different viewpoint perspectives comprises:
selecting the two or more different viewpoint perspectives to capture a range of perspectives of the given scene;
for each of the two or more different viewpoint perspectives, performing ray tracing through the given scene for a plurality of rays, where a color and density of each of the plurality of rays is computed using the three-dimensional scene reconstruction model; and
synthesizing the set of two-dimensional images of the given scene using the plurality of rays.

### Claim 5 (depends on 1)

The apparatus of claim 1 wherein the image diffusion model comprises a denoising diffusion probabilistic model (DDPM).

### Claim 6 (depends on 1)

The apparatus of claim 1 wherein applying the image diffusion model to the generated set of two-dimensional images comprises applying a noise-reduction process to the generated set of two-dimensional images by:
inputting the generated set of two-dimensional images to the image diffusion model;
predicting noise added at each timestep based at least in part on an output of the image diffusion model; and
removing the predicted noise from the generated set of two-dimensional images to generate the refined set of two-dimensional images.

### Claim 7 (depends on 1)

The apparatus of claim 1 wherein modifying the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images comprises:
estimating probability densities for pixels of the refined set of two-dimensional images; and
adjusting the set of parameters of the three-dimensional scene reconstruction model based at least in part on the estimated probability densities.

### Claim 8 (depends on 7)

The apparatus of claim 7 wherein estimating the probability densities for the pixels of the refined set of two-dimensional images utilizes a density estimation model that takes the refined set of two-dimensional images and the user prompt as input and computes probability density likelihoods of the pixels of the refined set of two-dimensional images.

### Claim 9 (depends on 7)

The apparatus of claim 7 wherein adjusting the set of parameters of the three-dimensional scene reconstruction model comprises utilizing a gradient descent algorithm that utilizes a loss function comprising a negative log-likelihood of the estimated probability densities for the pixels of the refined set of two-dimensional images.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein the user prompt comprises a natural language description of a design of a product, and wherein utilizing the modified three-dimensional scene reconstruction model to generate the three-dimensional representation of the given scene comprises generating a three-dimensional representation of a prototype of the product.

### Claim 11 (depends on 1)

The apparatus of claim 1 wherein the user prompt comprises a natural language description of a virtual showroom of one or more products, and wherein utilizing the modified three-dimensional scene reconstruction model to generate the three-dimensional representation of the given scene comprises generating a three-dimensional representation of the one or more products for the virtual showroom.

### Claim 12 (depends on 1)

The apparatus of claim 1 wherein the user prompt comprises a natural language description specifying one or more customizations of a product, and wherein utilizing the modified three-dimensional scene reconstruction model to generate the three-dimensional representation of the given scene comprises generating a three-dimensional representation of a customized version of the product based at least in part on the specified one or more customizations.

### Claim 13 (depends on 1)

The apparatus of claim 1 wherein the user prompt comprises a natural language description of one or more features of a product, and wherein utilizing the modified three-dimensional scene reconstruction model to generate the three-dimensional representation of the given scene comprises generating a three-dimensional representation of a training simulation for the one or more features of the product.

### Claim 14 (depends on 1)

The apparatus of claim 1 wherein the user prompt comprises a natural language description of a configuration of an information technology infrastructure environment, and utilizing the modified three-dimensional scene reconstruction model to generate the three-dimensional representation of the given scene comprises generating a three-dimensional representation of the configuration of the information technology infrastructure environment.

### Claim 15

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:
to extract a set of features from a user prompt using a natural language processing model;
to initialize a three-dimensional scene reconstruction model utilizing a set of parameters determined based at least in part on the set of features extracted from the user prompt;
to generate, utilizing the three-dimensional scene reconstruction model, a set of two-dimensional images of a given scene from two or more different viewpoint perspectives;
to apply an image diffusion model to the generated set of two-dimensional images to generate a refined set of two-dimensional images;
to modify the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images; and
to utilize the modified three-dimensional scene reconstruction model to generate a three-dimensional representation of the given scene.

### Claim 16 (depends on 15)

The computer program product of claim 15 wherein the three-dimensional scene reconstruction model comprises a Neural Radiance Field (NeRF) model configured to take as input a three-dimensional position vector and a two-dimensional viewing direction and output a color and density at each of two or more points of the given scene.

### Claim 17 (depends on 15)

The computer program product of claim 15 wherein modifying the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images comprises:
estimating probability densities for pixels of the refined set of two-dimensional images; and
adjusting the set of parameters of the three-dimensional scene reconstruction model based at least in part on the estimated probability densities.

### Claim 18

A method comprising:
extracting a set of features from a user prompt using a natural language processing model;
initializing a three-dimensional scene reconstruction model utilizing a set of parameters determined based at least in part on the set of features extracted from the user prompt;
generating, utilizing the three-dimensional scene reconstruction model, a set of two-dimensional images of a given scene from two or more different viewpoint perspectives;
applying an image diffusion model to the generated set of two-dimensional images to generate a refined set of two-dimensional images;
modifying the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images; and
utilizing the modified three-dimensional scene reconstruction model to generate a three-dimensional representation of the given scene;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

### Claim 19 (depends on 18)

The method of claim 18 wherein the three-dimensional scene reconstruction model comprises a Neural Radiance Field (NeRF) model configured to take as input a three-dimensional position vector and a two-dimensional viewing direction and output a color and density at each of two or more points of the given scene.

### Claim 20 (depends on 18)

The method of claim 18 wherein modifying the three-dimensional scene reconstruction model based at least in part on the refined set of two-dimensional images comprises:
estimating probability densities for pixels of the refined set of two-dimensional images; and
adjusting the set of parameters of the three-dimensional scene reconstruction model based at least in part on the estimated probability densities.
