System and method for generating virtual marks based on gaze tracking

A method, comprising:

• tracking, by a processing unit, a gaze of a user's eye based on images captured by a first user-facing detector;
• tracking motion of an end of a first writing tool by the processing unit based on images captured by a first scene camera and filtered for saccadic eye movements versus smooth pursuit eye movements of the user's eye in relation to the motion of the first writing tool;
• and
• generating, by the processing unit, a mark at a display corresponding to the tracked motion of an end of the first writing tool with respect to a first virtual surface, wherein:
• generating the mark is based on a proximity of the end of the first writing tool to the first virtual surface, the filtered smooth pursuit eye movements, and the tracked gaze of a first user's eye;
• generating the mark includes depositing virtual ink at the display corresponding to the motion of the end of the first writing tool in response to identifying that a direction of the first writing tool intersects with the first virtual surface;
• and
• recording the first mark continues recording the first mark on the first virtual writing surface when the gaze of the first user's eye leaves the first pointer for less than a threshold amount of time.

An electronic device, comprising:

• a first scene camera configured to track motion of an end of a first pointer with respect to a first virtual surface;
• a first user-facing camera configured to track a gaze of a first user's eye;
• and
• a processor configured to:
• filter the gaze of the first user's eye for saccadic eye movements versus smooth pursuit eye movements in relation to the motion of the first pointer;
• identify that a direction of the first pointer intersects with the first virtual surface;
• generate at a display a mark corresponding to the tracked motion of the end of the first pointer with respect to the first virtual surface based on a proximity of the end of the first pointer to the first virtual surface and the gaze of the first user's eye filtered for saccadic eye movements versus smooth pursuit eye movements in relation to the motion of the first pointer;
• and
• generate the mark by depositing virtual ink at the display corresponding to the motion of the end of the first pointer in response to identifying that the direction of the first pointer intersects with the first virtual surface and based on the filtered smooth pursuit eye movements;
• wherein generating the mark continues on the first virtual writing surface when the gaze of the first user's eye leaves the first pointer for less than a threshold amount of time.