Combining gaze input and touch surface input for user interfaces in augmented and/or virtual reality

A computer program product embodied on a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor, causes the processor to execute a method, the method comprising:

• displaying, in a virtual reality environment, a virtual keyboard;
• detecting an initial eye gaze directed at an initial key of a plurality of keys of the virtual keyboard;
• receiving an initial input at a controller;
• initializing an eye gaze input mode in response to the initial input from the controller and the detection of the initial eye gaze;
• receiving at least one character input in response to at least one of a detected eye gaze input or a detected manipulation of the controller;
• and
• displaying, in the virtual reality environment, a character entry in response to the received at least one character input.

The computer program product embodied on a non-transitory computer readable medium 16, receiving at least one character input in response to at least one of a detected eye gaze input or a detected manipulation at the external device including:

• detecting an eye gaze gesture corresponding to a plurality of sequentially selected keys of the virtual keyboard, including:
• detecting an eye gaze directed to a selected key of the plurality of keys;
• detecting a tap input on the touch surface of the controller or a manipulation of a button or switch on the controller;
• recording a character corresponding to the selected key in response to the detected tap input or manipulation;
• repeating the detecting, detecting and recording until an entry completion input is received;
• and
• displaying a plurality of characters corresponding to a plurality of sequentially selected keys of the virtual keyboard in response to the detected entry completion input.