Back to results
US 2024/0193848 A1Published application
Transformers as neural renderers
AssigneeNVIDIA Corporation
InventorsYue Wang, Marco Pavone
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to use one or more machine learning processes to obtain a set of feature values based at least in part on a set of locations along a ray that intersects an object. A color value is obtained based at least in part on the set of feature values. A view of the object may be generated using the color value. A path of motion may be determined based at least in part on the color value and used to cause a device to move.
Claims28
A method comprising:
- using at least one neural network to obtain a set of feature values based at least in part on a set of samples obtained by sampling along a direction;
- using at least one pooled feature value to obtain a color value based at least in part on the set of feature values;
- and
- causing a device to move based at least in part on a path of motion determined based at least in part on the color value.
1 more element
A system comprising:
- at least one processor;
- and
- memory storing instructions that when executed by the at least one processor cause the system to:
- perform one or more transformer models to obtain a set of feature values based at least in part on a set of locations along a ray intersecting an object;
- perform one or more machine learning processes to obtain a color value based at least in part on the set of feature values;
- and
- generate a view of the object using the color value.
4 more elements
A processor comprising:
- one or more circuits to:
- perform at least one transformer-based machine learning model to obtain a set of feature values based at least in part on a set of samples calculated to be positioned along a ray that intersects an obstacle,
- determine at least one color value based at least in part on the set of feature values, and
- generate a novel view of the obstacle using the at least one color value.
1 more element
Dependencies are inferred from the claim text.