Systems and Methods of Initiating Computerized Actions Using Eye Gaze and Eye Gestures

A system comprising:

• a display device having a display;
• an eye tracker;
• and
• a controller comprising:
• a memory;
• and
• a processor communicatively coupled to the memory, the memory storing instructions executable by the processor to:
• detect, via an eye tracker of a computing device, eye gaze data comprising a plurality of eye gaze data points of an eye movement of a user, the plurality of eye gaze data points comprising X, Y, and Z eye gaze coordinates;
• sample the detected eye gaze data points at a prescribed sampling interval;
• collect the sampled eye gaze data points and training a machine learning model using the sampled eye gaze data points, the machine learning model configured for establishing eye gaze patterns of the user;
• determine a context of a computing environment, comprising:
• identify an object of the computing environment;
• establish a location of the object within at least one bounding box, rectangular area or zone having a designated size in the computing environment;
• and
• determine a computerized action that is associated with the object;
• based on the eye gaze patterns of the user as established by the machine learning model, determine, by the machine learning model, a location of the plurality of eye gaze data points of the user in the computing environment;
• and
• initiate the computerized action associated with the object when the plurality of eye gaze data points of the user and the object are both located within the at least one bounding box, rectangular area or zone of the computing environment.

A method for initiating a computerized action using an eye gesture, comprising:

• detecting, via an eye tracker of a computing device, eye gaze data comprising a plurality of eye gaze data points of an eye movement of a user, the plurality of eye gaze data points comprising X, Y, and Z eye gaze coordinates;
• sampling the detected eye gaze data points at a prescribed sampling interval;
• collecting the sampled eye gaze data points and training a machine learning model using the sampled eye gaze data points, the machine learning model configured for establishing eye gaze patterns of the user;
• determining a context of a computing environment, comprising:
• identifying an object of the computing environment;
• establishing a location of the object within at least one bounding box, rectangular area or zone having a designated size in the computing environment;
• and
• determining a computerized action that is associated with the object;
• detecting, via the machine learning model, an eye gesture made by the user;
• storing the eye gesture and state in a historical eye gesture data repository;
• and
• in response to the detected eye gesture, initiating the computerized action associated with the object when the plurality of eye gaze data points of the user and the object are both located within the at least one bounding box, rectangular area or zone of the computing environment.