US 2017/0097687 A1 · METHOD AND SYSTEM FOR HUMAN-TO-COMPUTER GESTURE BASED SIMULTANEOUS INTERACTIONS USING SINGULAR POINTS OF INTEREST ON A HAND

Abstract

Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Claims26

Dependent claims

A method for providing natural human-to-computer interaction based on a three-dimensional hand gesture recognition system, the method comprising the steps of:

a) imaging a scene including at least one hand of at least one user;
b) processing the imaged scene to determine at least two points of interest associated with said at least one hand;
c) tracking said at least two points of interest to provide a tracked movement of each point of interest with respect to time;
d) analysing said tracked movement of each point of interest;
e) determining, from the analysis of said tracked movement, the simultaneous performance of an activation gesture based on two points of interest, and a pointing gesture based on a single point of interest;
and
f) using said determined performance of said activation gesture and said pointing gesture for human-to-computer interaction.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

15/380,993Filed 15 Dec 2016

Priority

7 Jan 2015

Published

6 Apr 2017

Term ends

Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…
G06F 3/011
Input arrangements or combined input and output arrangements for interaction between user and computer: arrangements for interaction with the…
G06F 3/0304
Arrangements for converting the position or the displacement of a member into a coded form: detection arrangements using opto-electronic means
G06F 3/04845
For the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a…:…

Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand

Life of this patent

Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand

Life of this patent

Abstract

Claims26