Gesture recognition system for tv control
AssigneeSony Corporation
InventorsKuang-Man Huang, Ming-Chang Liu, Liangyin Yu
Life of this patent
Estimating the term…
Abstract
A gesture recognition system using a skin-color based method combined with motion information to achieve real-time segmentation. A Kalman filter is used to track the centroid of the hand. The palm center, palm bottom, as well as the largest distance from the palm center to the contour from extracted hand mask are computed. The computed distance to a threshold is then compared to decide if the current posture is “open” or “closed.” In a preferred embodiment, the transition between the “open” and “closed” posture to decide if the current gesture is in “select” or “grab” state.
Claims20
A gesture recognition system for remote control of a device, comprising:
- (a) a sensor for capturing video data of a user's hand at a location near the device;
- (b) a processor for processing the captured video data of the hand;
- and
- (c) programming executable on said processor for carrying out steps comprising:
- segmenting each hand image in the captured video based on skin color;
- extracting one or more parameters of the segmented hand image;
- tracking the one or more parameters in the hand image;
- classifying a hand gesture as “open” or “closed” based on the one or more parameters;
- and
- operating the device based on recognition of said hand gesture and tracking the position of said one or more parameters.
A gesture recognition system for remote control of a device having a user interface for visualization on a display, comprising:
- (a) a sensor for capturing video data of a user's hand at a location near the device;
- (b) a processor for processing the captured video data of the hand;
- (c) programming executable on said processor for carrying out steps comprising:
- segmenting each hand image in the captured video based on skin color;
- extracting one or more parameters of the segmented hand image;
- tracking the one or more parameters in the hand image;
- classifying a hand gesture as “open” or “closed” based on said one or more parameters;
- and
- operating the device based on recognition of said hand gesture and tracking of said one or more parameters;
- wherein operating the device comprises sending a command to the user interface based on recognition of said hand gesture and tracking the position of said one or more parameters.
A method for remotely controlling a device using hand gestures, the device having a user interface for visualization on a display, the method comprising:
- capturing video of a user's hand with a sensor at a location near said device;
- segmenting each hand image in the captured video based on skin color;
- extracting one or more parameters of the segmented hand image;
- tracking the at least one of the one or more parameters in the hand image;
- classifying a hand gesture as “open” or “closed” based on said one or more parameters;
- operating the device based on recognition of said hand gesture and tracking of said one or more parameters;
- sending a command to the user interface based on recognition of said hand gesture and tracking of said one or more parameters;
- and
- outputting the sent command on the display to operate the device.
Dependencies are inferred from the claim text.