Gesture based human machine interface using marker
AssigneeCenter for Development of Telematics
InventorsVipin Tyagi, Sridharan B, Pallab Dutta, Maheshkumar Yadavrao Gadge, Giri Babu
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to system and method for gesture recognition for emulating a mouse for human machine interface wherein displacements, direction of displacements of cursor as also double click actions of mouse can be emulated by instinctive hand gestures. The method uses a marker as gesture interface and therefore does not depend on hand segmentation techniques, which suffer from deficiencies related to lighting conditions, variation of skin color from person to person and complexities of background.
Claims11
A method of generating a gesture recognition, the method comprising steps of:
- arranging a user-configurable physical marker associated with a user;
- capturing N frames of marker movement by an image capturing unit;
- capturing an image of said physical marker using said image capturing unit, wherein said captured image is a color image,
- determining a centroid of said physical marker for one or more of said N frames by the following operations:
- converting said image into a binary image, wherein said color image is converted into a gray image before converting into said binary image;
- identifying a boundary of said physical marker from said binary image;
- verifying rectangularity and/or convexity of said identified boundary to determine corners of said binary image;
- and
- determining the centroid of said physical marker from said determined corners;
- and
- determining displacement of said centroid for said one or more of said N frames;
- and
- generating a movement of a pointer on a display based on said determined displacement of said centroid, the movement of the pointer representing the gesture recognition associated with the user.
A system of generating a gesture recognition associated with a user, the system comprising:
- a frame capturing unit configured to capture and store a plurality of image frames of a user-configurable physical marker associated with a user, wherein said captured image is a color image;
- an image processing module configured to:
- convert said color image into a gray image before converting into a binary image;
- identify a boundary of said physical marker from said binary image;
- verify rectangularity and/or convexity of said identified boundary to determine corners of said binary image;
- and
- determine a centroid from said determined corners;
- a centroid tracking module configured to:
- compute a centroid position of said physical marker for one or more of said image frames;
- and
- a displacement determination module configured to compute displacement between a centroid of a current frame and a centroid of a previous frame, wherein said displacement determination module is further configured to enable movement of a cursor or pointer on a display when said computed displacement is greater than a first threshold value.
Dependencies are inferred from the claim text.