3D scanning with depth cameras using mesh sculpting
AssigneeSony Corporation
InventorPal Szasz
Life of this patent
Estimating the term…
Abstract
A method, performed by a mobile communication device, may include capturing one or more images from a depth camera, wherein the one or more images include depth information. The method may further include generating an initial sculpture for an entity in the captured one or more images; performing a ray casting process on the generated initial sculpture using the depth information; and deforming the initial sculpture based on the ray casting process to generate a sculpture for the entity.
Claims18
A method, performed by a computing device, comprising:
- capturing, by the computing device, one or more images from a depth camera, wherein the one or more images include depth information;
- generating, by the computer device, an initial sculpture for an entity in the captured one or more images;
- performing, by the computer device, a ray casting process on the generated initial sculpture using the depth information;
- and
- deforming, by the computer device, the initial sculpture based on the ray casting process to generate a sculpture for the entity;
- and
- wherein the initial sculpture includes a mesh polygon with vertices and triangular faces, and wherein performing the ray casting process on the generated initial sculpture using the depth information includes:
- casting a ray from an origin point to a particular data point included in the depth information;
- determining an intersection point of the cast ray with a particular triangular face of the mesh polygon;
- calculating a force vector to move the intersection point to the particular data point;
- and
- determining a vertex force vector for a vertex of the particular triangular face based on the calculated force vector.
A mobile communication device comprising:
- logic configured to:
- capture one or more images from a depth camera, wherein the one or more images include depth information;
- generate an initial sculpture for an entity in the captured one or more images;
- perform a ray casting process on the generated initial sculpture using the depth information;
- and
- deform the initial sculpture based on the ray casting process to generate a sculpture for the entity;
- and
- wherein the initial sculpture includes a mesh polygon with vertices and triangular faces, and wherein, when performing the ray casting process on the generated initial sculpture using the depth information, the logic is further configured to:
- cast a ray from an origin point to a particular data point included in the depth information;
- determine an intersection point of the cast ray with a particular triangular face of the mesh polygon;
- calculate a force vector to move the intersection point to the particular data point;
- and
- determine a vertex force vector for a vertex of the particular triangular face based on the calculated force vector.
A non-transitory computer-readable memory device storing instructions executable by a processor, the non-transitory computer-readable memory device comprising:
- one or more instructions to capture one or more images from a depth camera, wherein the one or more images include depth information;
- one or more instructions to generate an initial sculpture for an entity in the captured one or more images, wherein the initial sculpture includes a mesh polygon with vertices and triangular faces;
- one or more instructions to cast a ray from an origin point to a particular data point included in the depth information;
- one or more instructions to determine an intersection point of the cast ray with a particular triangular face of the mesh polygon;
- one or more instructions to calculate a force vector to move the intersection point to the particular data point;
- one or more instructions to determine a vertex force vector for a vertex of the particular triangular face based on the calculated force vector;
- and
- one or more instructions to deform the initial sculpture by moving the vertex based on the added up force vectors.
Dependencies are inferred from the claim text.