Determining a three-dimensional representation of a scene
AssigneeNVIDIA Corporation
InventorsYunzhi Lin, Jonathan Tremblay, Stephen Walter Tyree, Stanley Thomas Birchfield
Life of this patent
Estimating the term…
Abstract
One or more images (e.g., images taken from one or more cameras) may be received, where each of the one or more images may depict a two-dimensional (2D) view of a three-dimensional (3D) scene. Additionally, the one or more images may be utilized to determine a three-dimensional (3D) representation of a scene. This representation may help an entity navigate an environment represented by the 3D scene.
Claims31
A method, comprising:
- receiving one or more images;
- and
- processing the one or more images, using at least one neural network, to determine a three-dimensional (3D) representation of a scene.
A system comprising:
- a processor that is configured to:
- receive one or more images;
- and
- processing the one or more images, using at least one neural network, to determine a three-dimensional (3D) representation of a scene.
A non-transitory computer-readable media storing computer instructions which when executed by one or more processors cause the one or more processors to perform a method comprising:
- receiving one or more images;
- and
- processing the one or more images, using a neural network, to determine a three-dimensional (3D) representation of a scene.
A method, comprising:
- receiving at an entity one or more images captured utilizing one or more cameras mounted on or separately from the entity;
- processing the one or more images, using at least one neural network, to determine a three-dimensional (3D) representation of a scene, including:
- calculating a 3D reconstruction of the scene that includes a point cloud or point mesh,
- performing primitive shape segmentation within the scene,
- fitting 3D models to objects within the scene, and
- performing object pose estimation for one or more objects within the scene;
- and
- utilizing the 3D representation of the scene by the entity to navigate an environment illustrated by the scene.
Dependencies are inferred from the claim text.