Predictive information for free space gesture control and communication
AssigneeLeap Motion, Inc.
InventorsKevin A. Horowitz, David S. Holz
Life of this patent
Estimating the term…
Abstract
Free space machine interface and control can be facilitated by predictive entities useful in interpreting a control object's position and/or motion (including objects having one or more articulating members, i.e., humans and/or animals and/or machines). Predictive entities can be driven using motion information captured using image information or the equivalents. Predictive information can be improved applying techniques for correlating with information from observations.
Claims21
A method of capturing gestural motion of a control object in a three-dimensional (3D) sensory space, the method including:
- determining observation information characterizing a surface of a control object from at least one image of a gestural motion of the control object in a three-dimensional (3D) sensory space;
- constructing a 3D model to represent the control object by fitting one or more 3D subcomponents to the surface characterized, including:
- detecting fits of 3D subcomponents with colliding subcomponents based at least on identifying a subcomponent attribute incompatible with an attribute of another subcomponent;
- and
- fitting, to the surface, 3D subcomponents with least colliding subcomponents;
- and
- improving representation of the gestural motion by the 3D model, by
- adjusting the 3D model responsive to an error indication between a point on the surface characterized and a corresponding point on at least one of the 3D subcomponents.
A non-transitory computer readable storage medium impressed with computer program instructions to capture gestural motion of a control object in a three-dimensional (3D) sensory space, which instructions, when executed on a processor, implement a method including:
- determining observation information characterizing a surface of a control object from at least one image of a gestural motion of the control object in a three-dimensional (3D) sensory space;
- constructing a 3D model to represent the control object by fitting one or more 3D subcomponents to the surface characterized, including:
- detecting fits of 3D subcomponents with colliding subcomponents based at least on identifying a subcomponent attribute incompatible with an attribute of another subcomponent;
- and
- fitting, to the surface, 3D subcomponents with least colliding subcomponents;
- and
- improving representation of the gestural motion by the 3D model, by
- adjusting the 3D model responsive to an error indication between a point on the surface characterized and a corresponding point on at least one of the 3D subcomponents.
A system for capturing gestural motion of a control object in a three-dimensional (3D) sensory space, comprising:
- a processor and a non-transitory computer readable storage medium storing computer instructions configured to cause the processor to:
- determine observation information characterizing a surface of a control object from at least one image of a gestural motion of the control object in a three-dimensional (3D) sensory space;
- construct a 3D model to represent the control object by fitting one or more 3D subcomponents to the surface characterized, including:
- detecting fits of 3D subcomponents with colliding subcomponents based at least on identifying a subcomponent attribute incompatible with an attribute of another subcomponent;
- and
- fitting, to the surface, 3D subcomponents with least colliding subcomponents;
- and
- improve representation of the gestural motion by the 3D model, by
- adjusting the 3D model responsive to an error indication between a point on the surface characterized and a corresponding point on at least one of the 3D subcomponents.
Dependencies are inferred from the claim text.