Gaze-based human interface controls

A method, comprising:

• capturing video frames including eyes of an operator directed to a display that is presenting an interface;
• mapping gazes or movements of the eyes to interface elements of the interface based on the video frames;
• identifying interface operations associated with the interface elements based on the gazes or the movements;
• and
• causing the interface to process the interface operations on the interface elements;
• and
• processing the method as a logical Human-Interface Device (HID) without modification to the interface that is an existing interface.

A system, comprising:

• at least one camera configured to capture video frames comprise eyes of an operator of a device;
• the device comprising:
• a processor and non-transitory computer-readable storage medium having executable instructions representing an interface and an eye-based Human Interface Device (HID) controller for the interface;
• the eye-based HID controller when executed by the processor from the non-transitory computer-readable storage medium causes the processor to perform processing comprising:
• tracking gazes of the eyes, movements of the eyes, and second movements of eyelids of the eyes from the video frames captured by the at least one camera;
• mapping the gazes, the movements, and the second movements to interface elements associated with the interface that is presented on a display of the device;
• determining interface operations associated with the interface elements and recognized by the interface;
• processing the interface operations with the interface to control the interface based on the gazes, the movements, and the second movements;
• and
• processing the interface and an eye-based Human Interface Device (HID) controller as a logical Human-Interface Device (HID) without modification to the interface that is an existing interface.