# US 2026/0065056 A1 · Compact representations for neural material networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065056 A1
- Document ID: US20260065056A1
- Status: Published application
- Kind: A1
- Application number: 19/386,780
- Filed: 2025-11-12
- Published: 2026-03-05
- Earliest claimed: 2023-01-27
- Applicants: NVIDIA Corporation
- Inventors: Aaron Eliot Lefohn; Andrea Weidlich; Benedikt Bitterli; Fabrice Pierre Armand Rousselle; Jan Novák; Carl Franz Petrik Clarberg; Stephen Marschner; Tizian Lucien Zeltner; Yaobin Ouyang; Craig Kolb
- Web page: https://patentgrep.com/patent/US20260065056A1

## CPC

- G06N 3/08: Learning methods
- G06V 10/82: using neural networks
- G06T 15/00: Three-dimensional [3D] image rendering
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the present disclosure relate to training methods for training mixed-precision neural networks, particularly neural material networks. In an embodiment, a mixed-precision neural material network includes input, hidden, and output layers having different numerical precisions that is trained or fine-tuned to encode and/or decode compact latent code representations.

## Claims

### Claim 1

A method for training a neural network, comprising:
receiving initial parameters for the neural network that are represented in a first format for the neural network;
converting at least a portion of the initial parameters into a second format that represents values in fewer bits compared with the first format to produce training parameters;
applying the training parameters, by the neural network, to process training inputs and generate predicted outputs; and
updating the training parameters by backpropagating loss gradients represented in a third format that are computed to reduce differences between the predicted outputs and reference outputs associated with the training inputs, wherein the third format represents values in at least as many bits as the second format.

### Claim 2 (depends on 1)

The method of claim 1, wherein the third format represents values in more bits than the second format and the updating comprises:
adjusting the initial parameters using the loss gradients to produce updated initial parameters; and
converting the updated initial parameters into the second format to update the training parameters.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first format comprises a 16-bit or 32-bit floating point format and the second format comprises a low-precision floating point format including 8 or fewer bits, and the third format comprises the 16-bit or 32-bit floating point format.

### Claim 4 (depends on 3)

The method of claim 3, wherein the low-precision floating point format comprises a sign bit and one of 5 exponent bits and 2 mantissa bits, 4 exponent bits and 3 mantissa bits, 3 exponent bits and 2 mantissa bits, 2 exponent bits and 3 mantissa bits, 2 exponent bits and 1 mantissa bit.

### Claim 5 (depends on 1)

The method of claim 1, wherein the neural network comprises a material encoder that generates a latent code and a neural material decoder that processes the latent code according to at least a portion of the training parameters to produce the predicted outputs.

### Claim 6 (depends on 5)

The method of claim 5, wherein the neural material decoder predicts reflectance attributes of a material associated with a surface at a point intersected by a ray.

### Claim 7 (depends on 5)

The method of claim 5, wherein the latent code is quantized for processing by the neural material decoder.

### Claim 8 (depends on 5)

The method of claim 5, wherein the latent code is represented in a low dynamic range texture format.

### Claim 9 (depends on 5)

The method of claim 5, further comprising:
compressing the latent code;
storing the compressed latent code; and
decompressing the compressed latent code for input to the neural material decoder.

### Claim 10 (depends on 5)

The method of claim 5, further comprising:
compressing at least one of a color value, normal vector, or roughness property associated with the latent code to produce a compressed material component;
storing the compressed material component; and
decompressing the compressed material component for input to the neural material decoder.

### Claim 11 (depends on 1)

The method of claim 1, wherein the neural network comprises a neural material network that predicts reflectance attributes of a material associated with a surface at a point intersected by a ray.

### Claim 12 (depends on 1)

The method of claim 1, wherein the training parameters are represented in mixed numerical precisions across different layers of the neural network, such that:
input and output layers apply parameters represented in the first format; and
apply parameters represented in the second format.

### Claim 13 (depends on 1)

The method of claim 1, further comprising converting the initial parameters from a high-precision format into the first format that is represented using fewer bits compared with the high-precision format.

### Claim 14 (depends on 1)

The method of claim 1, wherein the method is performed by at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system implementing one or more vision language models (VLMs);
a system implementing one or more multi-modal language models;
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system for performing one or more generative AI operations;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center;
a system implemented at least partially using cloud computing resources;
a system using or deploying one or more inference microservices;
a system that incorporates one or more machine learning models deployed in a service or microservice along with an OS-level virtualization package (e.g., a container).

### Claim 15

A system for training a neural network, comprising:
a memory that stores initial parameters represented in a first (high precision) format that define the neural network; and
a processor that is connected to the memory, wherein the processor is configured to train the neural network by:
converting at least a portion of the initial parameters into a second (low or mid precision) format that represents values in fewer bits compared with the first format to produce training parameters;
applying the training parameters, by the neural network, to process training inputs and generate predicted outputs; and
updating the training parameters by backpropagating loss gradients represented in a third format that are computed to reduce differences between the predicted outputs and reference outputs associated with the training inputs, wherein the third format represents values in at least as many bits as the second format.

### Claim 16 (depends on 15)

The system of claim 15, wherein the third format represents values in more bits than the second format and the updating comprises:
adjusting the initial parameters using the loss gradients to produce updated initial parameters; and
converting the updated initial parameters into the second format to update the training parameters.

### Claim 17 (depends on 15)

The system of claim 15, wherein the first format comprises a 16-bit or 32-bit floating point format and the second format comprises a low-precision floating point format including 8 or fewer bits, and the third format comprises the 16-bit or 32-bit floating point format.

### Claim 18 (depends on 15)

The system of claim 15, wherein the training parameters are represented in mixed numerical precisions across different layers of the neural network, such that:
input and output layers apply parameters represented in the first format; and
apply parameters represented in the second format.

### Claim 19

A non-transitory computer-readable media storing computer instructions for training a neural network that, when executed by one or more processors, cause the one or more processors to perform the steps of:
receiving initial parameters for the neural network that are represented in a first format for the neural network;
converting at least a portion of the initial parameters into a second format that represents values in fewer bits compared with the first format to produce training parameters;
applying the training parameters, by the neural network, to process training inputs and generate predicted outputs; and
updating the training parameters by backpropagating loss gradients represented in a third format that are computed to reduce differences between the predicted outputs and reference outputs associated with the training inputs, wherein the third format represents values in at least as many bits as the second format.

### Claim 20 (depends on 19)

The non-transitory computer-readable media of claim 19, wherein herein the third format represents values in more bits than the second format and the updating comprises:
adjusting the initial parameters using the loss gradients to produce updated initial parameters; and
converting the updated initial parameters into the second format to update the training parameters.
