US 10,628,729 B2Granted

System and method for body scanning and avatar creation

AssigneeStyku, LLC

InventorRaj Sareen

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method and apparatus is disclosed for scanning a body. The system comprises a processor and a range camera capable of capturing at least a first set of depth images of the body rotated to 0 degrees and at least a second set of depth images of the body rotated to x degrees, wherein x is >0 degrees, and x<360 degrees. A first set of computer instructions executable on the processor is capable of calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images. A second set of computer instructions executable on the processor is capable of rotating and translating the first and second set of three dimensional points into a final set of three dimensional points. A third set of computer instructions executable on the processor is capable of creating a three dimensional mesh from the final set of three dimensional points.

Claims20

Dependent claims

A system for scanning and measuring a surface of a body of a person, including any clothing worn, comprising:

a processor;
an infrared camera comprising an infrared light emitter that emits infrared light and at least an infrared sensor that reads reflected infrared light;
a first set of computer instructions executable on the processor capable causing the infrared emitter to illuminate the surface of the body with infrared light and to cause the infrared sensor to capture the infrared light reflected off the surface of the body;
a second set of computer instructions executable on the processor capable of capturing and storing the reflected infrared light in at least a first depth image of a surface of a body from at least a first point of view while the body is in a pose and at least a second depth image of the outer surface of the body from at least a second point of view while the body remains in the same pose;
a third set of computer instructions executable on the processor capable of calculating a first set of three dimensional points from the first depth image and a second set of three dimensional points from the second depth image;
a fourth set of computer instructions executable on the processor capable of applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;
a fifth set of computer instructions executable on the processor capable of reconstructing the surface of the body by minimizing an error between the first and second set of three dimensional points by repeatedly making iterative and small changes to the matrix transformations and then re-calculating the error until the error is minimized;
a sixth set of computer instructions executable on the processor capable of applying poisson surface reconstruction to construct a mesh;
a seventh set of computer instructions executable on the processor capable of rigging the mesh with a biped bone structure, scaled and sized to appropriately fit the mesh;
an eighth set of computer instructions executable on the processor capable of utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;
a ninth set of computer instructions executable on the processor capable of extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body's surface.

8 more elements

A method for scanning and measuring a surface of a body of a person, including any clothing worn, comprising:

causing an infrared camera to illuminate the surface of the body with infrared light and to capture the infrared light reflected off the surface of the body, the infrared camera comprising an infrared light emitter that is capable of emitting the infrared light, the infrared camera further comprising an infrared sensor that is capable of reading reflected infrared light;
storing the reflected infrared light in at least a first depth image of a surface of a body from at least a first point of view while the body is in a pose and at least a second depth image of the surface of the body from at least a second point of view while the body remains in the same pose;
calculating a first set of three dimensional points from the first depth image and a second set of three dimensional points from the second depth image;
applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;
applying poisson surface reconstruction to construct a mesh;
rigging the mesh with a biped bone structure, scaled and sized to appropriately fit the mesh;
utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;
and
a ninth set of computer instructions executable on the processor capable of extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body's surface.

6 more elements

A system for scanning and measuring a surface of a body of a person, including any clothing worn, comprising:

a processor;
an infrared camera comprising an infrared light emitter that emits infrared light to illuminate the surface of the body including any clothing worn, and two or more infrared sensors that capture reflected infrared light resulting from the emitter's illuminating of the surface of the body;
a first set of computer instructions executable on the processor capable of causing the infrared camera to illuminate the surface of the body with infrared light and to capture the infrared light reflected off the surface of the body;
a second set of computer instructions executable on the processor capable of capturing and storing reflected infrared light in at least a first depth image of a surface of a body from at least a first point of view while the body is in a pose and at least a second depth image of the surface of the body from at least a second point of view while the body remains in the same pose;
a third set of computer instructions executable on the processor capable of calculating a first set of three dimensional points from the first depth image and a second set of three dimensional points from the second depth image;
a fourth set of computer instructions executable on the processor capable of applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;
a fifth set of computer instructions executable on the processor capable of reconstructing the surface of the body by minimizing an error between the first and second set of three dimensional points by repeatedly making iterative and small changes to the matrix transformations and then re-calculating the error until the error is minimized;
a sixth set of computer instructions executable on the processor capable of applying poisson surface reconstruction to construct a mesh;
a seventh set of computer instructions executable on the processor capable of rigging the mesh with a biped bone structure, scaled and sized to appropriately fit the mesh;
an eighth set of computer instructions executable on the processor capable of utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;
and
a ninth set of computer instructions executable on the processor capable of extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body's surface.

9 more elements

A system for scanning and measuring a surface of a body of a person including any clothing worn, comprising:

a processor;
an infrared camera comprising an infrared light emitter that emits infrared light and at least an infrared sensor that reads reflected infrared light;
a first set of computer instructions executable on the processor capable of illuminating the surface of the body with infrared light and capturing the infrared light reflected off the surface of the body;
a second set of computer instructions executable on the processor capable of capturing and storing reflected infrared light in at least a first depth image of a surface of a body from at least a first point of view while the body is in a pose and at least a second depth image of the surface of the body from at least a second point of view while the body remains in the same pose;
a third set of computer instructions executable on the processor capable of calculating a first set of three dimensional points from the first depth image and a second set of three dimensional points from the second depth image;
a fourth set of computer instructions executable on the processor capable of applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;
a fifth set of computer instructions executable on the processor capable of applying poisson surface reconstruction to construct a mesh;
a sixth set of computer instructions executable on the processor capable of rigging the mesh with a biped bone structure, scaled and sized to appropriately fit the mesh;
a seventh set of computer instructions executable on the processor capable of utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;
and
an eighth set of computer instructions executable on the processor capable of extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body's surface.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 13/159,401Filed 13 Jun 2011 · continuation in part
Priority: 8 Jun 2010
Published: US 2012/0086783 A112 Apr 2012
Granted: 21 Apr 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06N 3/006
Artificial life, i.e. computing arrangements simulating life: based on simulated virtual individual or collective life forms, e.g. social…
G06T 19/00
Manipulating three-dimensional [3d] models or images for computer graphics
G06T 2210/16
Indexing scheme for image generation or computer graphics: cloth
G06V 40/103
Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands: static body considered as a whole, e.g. static pedestrian…

Family

Application61/352,390Us provisional application · filed 8 Jun 2010
Application13/008,906Parent of this continuation-in-part · filed 19 Jan 2011
US 2012/0086783 A1Pre-grant publication · published 12 Apr 2012
US 2011/0298897 A1Published application
US 10,628,729 B2This patent

From the US filing history. Foreign family members aren’t listed.