Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction

An apparatus for providing a large number of graphical elements to an individual who is interacting with a multimedia terminal, comprising:

• (a) means for capturing a plurality of images from said individual,
• (b) means for calculating a color segmentation image of said individual in said plurality of images,
• (c) means for calculating a motion energy image of said individual in said plurality of images,
• (d) means for calculating a body part location confidence image of said individual by combining said color segmentation image and said motion energy image,
• wherein combining said color segmentation image and said motion energy image is performed by adding and multiplying the images together, and
• (e) means for displaying said large number of graphical elements on said multimedia terminal that correspond to the body part location estimates of said individual in the body part location confidence image,
• whereby said large number of graphical elements provides said individual with information about what the apparatus senses and the certainty with which the apparatus has sensed said body part location estimates,
• whereby said large number of graphical elements gives said individual an opportunity to have a better understanding about the capabilities of said multimedia terminal to sense said body movements, and
• whereby said understanding helps said individual to adapt to the capabilities of said multimedia terminal, leading to an improved interaction experience.