System and method for dense, large scale scene reconstruction
AssigneeOccipital, Inc.
InventorsJeffrey Powers, Nicolas Burrus, Yuping Lin, Paul Schroeder
Life of this patent
Estimating the term…
Abstract
A system configured to improve the operations associated with generating virtual representations on limited resources of a mobile device. In some cases, the system may utilize viewpoint bundles that include collection of image data with an associated pose in relative physical proximity to each other to render a virtual scene. In other cases, the system may utilize 2.5D manifolds including 2D image data and a weighted depth value to render the 3D environment.
Claims20
A method comprising:
- receiving a first voxel block of a first size and a second voxel block of a second size, the second size coarser than the first size;
- generating a super voxel block including at least the first voxel block and the second voxel block;
- integrating adjacent voxel blocks of the super voxel block having the second size using one marching pyramid into a mesh;
- integrating up to four adjacent voxel blocks of the first size with a share-plane of the super voxel block using four marching pyramids into the mesh;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing three edges within the super voxel block using two marching pyramids and one marching tetrahedral into the mesh;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing two edges within the super voxel block using three marching pyramids, two marching pyramids, and two marching tetrahedras into the mesh;
- and
- integrating voxel blocks of the first size and voxel blocks of the second size sharing one edges within the super voxel block using four marching pyramids into the mesh.
A system comprising:
- a display for presenting a virtual environment to a user;
- one or more image components for capturing image data associated with a physical environment surrounding the user;
- one or more processors;
- non-transitory computer-readable media storing computer-executable instructions, which when executed by the one or more processors cause the one or more processors to perform operations including:
- receiving a first voxel block of a first size and a second voxel block of a second size;
- generating a super voxel block including at least the first voxel block and the second voxel block;
- integrating adjacent voxel blocks of the super voxel block having the second size using a first set of functions into a mesh;
- integrating up to four adjacent voxel blocks of the first size with a share-plane of the super voxel block using a second set of functions into the mesh;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing three edges within the super voxel block using a third set of functions into the mesh;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing two edges within the super voxel block using a fourth set of functions into the mesh;
- and
- integrating voxel blocks of the first size and voxel blocks of the second size sharing one edges within the super voxel block using a fifth set of functions into the mesh.
A non-transitory computer-readable media storing computer-executable instructions, which when executed by the one or more processors cause the one or more processors to perform operations including:
- generating a super voxel block including at least the first voxel block and the second voxel block;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing three edges within the super voxel block using two marching pyramids and one marching tetrahedral into the mesh;
- integrating voxel blocks of the first size and voxel blocks of the second size sharing two edges within the super voxel block using three marching pyramids, two marching pyramids, and two marching tetrahedras into the mesh;
- and
- integrating voxel blocks of the first size and voxel blocks of the second size sharing one edges within the super voxel block using four marching pyramids into the mesh.
Dependencies are inferred from the claim text.