Systems and methods for a gaze and gesture interface

A system wherein a person interacts with one or more or a plurality of 3D objects through a gaze with a first eye and through a gesture by a body part, comprising:

• a computer display that displays the plurality of 3D objects;
• a head frame containing a first camera adapted to point at the first eye of the person wearing the head frame and a second camera adapted to point to an area of the computer display and to capture the gesture;
• a processor, enabled to execute instructions to perform the steps:
• receiving data transmitted by the first and second cameras;
• processing the received data to determine a 3D object in the plurality of objects where the gaze is directed at;
• processing the received data to recognize the gesture from a plurality of gestures;
• and
• further processing the 3D object based on the gaze and gesture.

A device with which a person interacts with a 3D object displayed on a 3D computer display through a gaze from a first eye and a gaze from a second eye and through a gesture by a body part of the person, comprising:

• a frame adapted to be worn by the person;
• a first camera mounted in the frame adapted to point at the first eye to capture the first gaze,
• a second camera mounted in the frame adapted to point at the second eye to capture the second gaze,
• a third camera mounted in the frame adapted to point at the 3D computer display and to capture the gesture,
• a first and a second glass mounted in the frame such that the first eye looks through the first glass and the second eye looks through the second glass, the first and second glasses acting as 3D viewing shutters;
• and
• a transmitter to transmit data generated by the cameras.