System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs

A system for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs of a user of the system, comprising:

• a computer-readable memory means;
• means for generating video signals indicative of the gestures of the system user and an interaction area surrounding the system user;
• means for displaying video images, the video image display means being positioned in front of the system user;
• and
• means for processing the video signals, in accordance with a program stored in the computer-readable memory means, to determine the three-dimensional positions of the body and principle body parts of the system user, wherein the video signal processing means constructs three-dimensional images of the system user and interaction area on the video image display means based upon the three-dimensional positions of the body and principle body parts of the system user, the video image display means displays three-dimensional graphical objects within the virtual reality environment, and movement by the system user permits apparent movement of the three-dimensional objects displayed on the video image display means so that the system user appears to move throughout the virtual reality environment,
• wherein when the system user bends at the waist, the video signal processing means rotates the three-dimensional graphical objects on the video image display means so that three-dimensional graphical objects in front of the system user can be seen by the system user.

A method for permitting three-dimensional navigation through a virtual reality environment, the method comprising the steps of:

• generating video signals indicative of the gestures of the system user and an interaction area surrounding the system user;
• processing the video signals to determine the three-dimensional positions of the body and principle body parts of the system user;
• constructing three-dimensional images of the system user and interaction area based upon the three-dimensional positions of the body and principle body parts of the system user;
• and
• displaying three-dimensional graphical objects within the virtual reality environment, wherein movement by the system user permits apparent movement by the three-dimensional objects displayed so that the system user appears to move throughout the virtual reality environment, wherein when the system user raises his/her hand, rotating the displayed three-dimensional graphical objects so that the system user appears to be rotating through the virtual reality environment.

A method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs of a user of a computer system, the method comprising the steps of:

• generating video signals indicative of the gestures of the system user and an interaction area surrounding the system user;
• processing the video signals to determine the three-dimensional positions of the body and principle body parts of the system user including the system user's leg;
• constructing three-dimensional images of the system user and interaction area based upon the three-dimensional positions of the body and principle body parts of the system user;
• and
• displaying three-dimensional graphical objects within the virtual reality environment, wherein movement by the system user's leg permits apparent movement by the three-dimensional objects displayed on the video image display so that the system user appears to move throughout the virtual reality environment,
• wherein when the system user bends at the waist, rotating the three-dimensional graphical objects displayed so that three-dimensional graphical objects in front of the system user can be seen by the system user.