US 9,864,433 B2 · Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand

Abstract

Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm center and center of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analyzed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Claims21

Dependent claims

A method for providing natural human-to-computer interaction based on a three-dimensional hand gesture recognition system, the method comprising:

a) imaging a scene including at least one hand of at least one user;
b) processing the imaged scene to determine at least three points of interest associated with said at least one hand;
c) tracking said at least three points of interest to provide a tracked movement of each point of interest with respect to time;
d) analysing said tracked movement of each point of interest;
e) determining, from the analysis of said tracked movement of said at least three points of interest, a simultaneous performance of an activation gesture based on two points of interest of the at least three points of interest, and a pointing gesture based on a single point of interest of the at least three points of interest;
and
f) using said determined performance of said activation gesture and said pointing gesture for human-to-computer interaction.

4 more elements

Dependencies are inferred from the claim text.

Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand

Life of this patent

Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand

Life of this patent

Abstract

Claims21