# US 2025/0095229 A1 · Scene generation using neural radiance fields

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095229 A1
- Document ID: US20250095229A1
- Status: Published application
- Kind: A1
- Application number: 18/397,081
- Filed: 2023-12-27
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Yue Wang; Jiawei Yang; Boris Ivanovic; Xinshuo Weng; Or Litany; Danfei Xu; Seung Wook Kim; Sanja Fidler; Marco Pavone; Boyi Li; Tong Che
- Web page: https://patentgrep.com/patent/US20250095229A1

## CPC

- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/82: using neural networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Apparatuses, systems, and techniques to generate an image of an environment. In at least one embodiment, one or more neural networks are used to identify one or more static and dynamic features of an environment to be used to generate a representation of the environment.

## Claims

### Claim 1

A method of generating one or more images comprising:
accessing a three-dimensional (3D) representation of an environment;
determining one or more static features and one or more dynamic features of the 3D representation;
determining, using the one or more static features, one or more static density values;
determining, using the one or more dynamic feature, one or more dynamic density values; and
generating the one or more images based on the one or more static density values and the one or more dynamic density values.

### Claim 2 (depends on 1)

The method of claim 1, further comprising generation one or more color values based on the one or more static features and the one or more dynamic features; and
generating the one or more images using the one or more color values.

### Claim 3 (depends on 1)

The method of claim 1, wherein the 3D representation of the environment is a neural radiance field (NeRF).

### Claim 4 (depends on 1)

The method of claim 1, further comprising determining a viewing direction associated with an autonomous machine; and
using the viewing direction to generate the one or more images.

### Claim 5 (depends on 1)

The method of claim 1, wherein the one or more static features are determined using a feature encoder associated with a position within the environment.

### Claim 6 (depends on 1)

The method of claim 1, wherein the one or more dynamic features are determined using a feature encoder associated with a position and indication of time associated with the 3D representation of the environment.

### Claim 7 (depends on 1)

The method of claim 1, further comprising using one or more neural networks to generate the one or more images.

### Claim 8

A non-transitory computer readable storage medium storing thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to:
access a three-dimensional (3D) representation of an environment;
determine one or more static features and one or more dynamic features of the 3D representation;
determine, using the one or more static features, one or more static density values;
determine, using the one or more dynamic feature, one or more dynamic density values; and
generate one or more images based on the one or more static density values and the one or more dynamic density values.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the computer system is further caused to generate one or more color values based on the one or more static features and the one or more dynamic features; and
generate the one or more images using the one or more color values.

### Claim 10 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the 3D representation of the environment is a neural radiance field (NeRF).

### Claim 11 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the computer system is further caused to determine a viewing direction associated with an autonomous machine; and
use the viewing direction to generate the one or more images.

### Claim 12 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the one or more static features are determined using a feature encoder associated with a position within the environment.

### Claim 13 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the one or more dynamic features are determined using a feature encoder associated with a position and indication of time associated with the 3D representation of the environment.

### Claim 14 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein one or more neural networks are used to generate the one or more images.

### Claim 15

A system comprising:
one or more processors to:
access a three-dimensional (3D) representation of an environment;
determine one or more static features and one or more dynamic features of the 3D representation;
determine, using the one or more static features, one or more static density values;
determine, using the one or more dynamic feature, one or more dynamic density values; and
generate one or more images based on the one or more static density values and the one or more dynamic density values.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more processors are further to generate one or more color values based on the one or more static features and the one or more dynamic features; and
generate the one or more images using the one or more color values.

### Claim 17 (depends on 15)

The system of claim 15, wherein the 3D representation of the environment is a neural radiance field (NeRF).

### Claim 18 (depends on 15)

The system of claim 15, wherein the one or more processors are further to determine a viewing direction associated with an autonomous machine; and
use the viewing direction to generate the one or more images.

### Claim 19 (depends on 15)

The system of claim 15, wherein the one or more dynamic features are determined using a feature encoder associated with a position and indication of time associated with the 3D representation of the environment.

### Claim 20 (depends on 15)

The system of claim 15, wherein the system is comprised in at least one of:
a control system for an autonomous or semi-autonomous machine; a perception system for an autonomous or semi-autonomous machine;
a first system for performing simulation operations;
a second system for performing deep learning operations;
a third system implemented using an edge device;
a fourth system implemented using a robot;
a fifth system incorporating one or more virtual machines (VMs);
a sixth system implemented at least partially in a data center;
a seventh system for performing digital twin operations;
an eighth system for performing light transport simulation;
a ninth system for performing collaborative content creation for 3D assets;
a tenth system for performing conversational Artificial Intelligence operations;
an eleventh system for generating synthetic data;
a twelfth system for implementing a web-hosted service for detecting program workload inefficiencies; an application as an application programming interface (“API”);
a thirteenth system implemented at least partially using cloud computing resources;
a fourteenth system for presenting one or more of virtual reality content, augmented reality content, or mixed reality content; or
a fifteenth system implementing one or more large language models (LLMs).
