Systems and methods of interpreting complex gestures
AssigneeLeap Motion, Inc.
InventorsDavid HOLZ, Matias PEREZ, Neeloy ROY, Maxwell Sills
Life of this patent
Estimating the term…
Abstract
The technology disclosed relates to using a curvilinear gestural path of a control object as a gesture-based input command for a motion-sensing system. In particular, the curvilinear gestural path can be broken down into curve segments, and each curve segment can be mapped to a recorded gesture primitive. Further, certain sequences of gesture primitives can be used to identify the original curvilinear gesture.
Claims20
A method of interpreting complex gestures, the method including:
- capturing a plurality of digital images of a non-linear free-form gesture in a three-dimensional (3D) sensory space performed by a control object;
- determining a path of movement of the control object during the non-linear free-form gesture;
- segmenting the path into multiple curve segments at least one of vertices, mid-points, and inflection points;
- piecewise fitting at least some of the curve segments to second or third order curves;
- identifying curve primitives in a library that match the piecewise fitted curve segments;
- mapping one or more geometric attributes of the piecewise fitted curve segments to parameters of the curve primitives;
- and
- forwarding the mapped parameters and curve primitives to a further process for interpretation as commands.
A method of detecting erroneous interpretation of a gesture, further including:
- representing a sequence of gesture primitives mapped to gesture segments of a gesture as a gesture-tag sequence, wherein the gesture-tag sequence includes one or more characters;
- anticipating a next component of gesture-tags in the gesture-tag sequence based on a model sequence of gesture primitives that identifies future occurrences of one or more subsequent gesture-tags given prior occurrences of one or more previous gesture-tags;
- comparing the anticipated component with an actual component of gesture-tags representing next gesture primitives;
- and
- determining an erroneous fitting of the gesture segments responsive to detecting a mismatch between the next component and actual component.
A system of interpreting complex gestures, the system including:
- a processor coupled to memory, the memory including computer instructions that, when executed, cause the processor to:
- capture a plurality of digital images of a non-linear free-form gesture in a three-dimensional (3D) sensory space performed by a control object;
- determine a path of movement of the control object during the non-linear free-form gesture;
- segment the path into multiple curve segments at vertices and inflection points;
- piecewise fit at least some of the curve segments to second or third order curves;
- identify curve primitives in a library that match the piecewise fitted curve segments;
- map one or more geometric attributes of the piecewise fitted curve segments to parameters of the curve primitives;
- and
- forward the mapped parameters and curve primitives to a further process for interpretation as commands.
Dependencies are inferred from the claim text.