Tracking and 3D reconstruction of unknown objects
AssigneeNVIDIA Corporation
InventorsBowen Wen, Jonathan Tremblay, Valts Blukis, Jan Kautz, Stanley Thomas Birchfield
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques for constructing a data structure to store a shape of an object based at least in part on a portion of multiple images, and obtaining poses of the object by tracking a pose of the object through the multiple images based at least in part on the data structure. Optionally, the poses may be used to generate a plan for a path of a device to travel, generate a rendering of at least a portion of a Mixed Reality (“MR”) display to be viewed by a user, and/or the like.
Claims26
A computer-implemented method, comprising:
- constructing a data structure to store a shape of an object based at least in part on input data from each image of a plurality of images that depict at least a portion of the object;
- tracking, based at least in part on information stored in the data structure, a pose of the object through the plurality of images to obtain a plurality of poses of the object;
- and
- generating, using the plurality of poses, at least one of a plan for a path of a device to travel or a rendering of at least a portion of a Mixed Reality (“MR”) display to be viewed by a user.
A system, comprising:
- one or more processors;
- and
- memory storing executable instructions that, as a result of being executed by the one or more processors, cause the system to reconstruct a model of an unknown object based at least in part on input data related to tracking a pose of the unknown object depicted in each image of a plurality of images.
A non-transitory machine-readable medium having stored thereon a set of instructions, which if performed by one or more processors, cause the one or more processors to at least:
- track poses of an object depicted in each frame of a plurality of frames of a video sequence;
- and
- construct a model of the object based at least in part on the poses of the object.
Dependencies are inferred from the claim text.