System and method for gaze estimation based on event cameras
AssigneeAmc
InventorShengwei Da
Life of this patent
Estimating the term…
Abstract
One embodiment of this disclosure can provide a system and method for estimating user gazes. During operation, the system can obtain an event stream captured by an event camera monitoring movement of a user's eye, generate an event image by accumulating, at a pixel level, events that occurred within a predetermined interval based on the event stream and determining a pixel value of each pixel based on the accumulated events associated with the pixel, and input the event image to a gaze-estimation machine learning model, which generates a first prediction output regarding a direction of the user's eye movement and a second prediction output regarding a speed of the user's eye movement.
Claims20
A computer-implemented method, comprising:
- obtaining an event stream captured by an event camera monitoring movement of a user's eye;
- generating an event image by accumulating, at a pixel level, events that occurred within a predetermined interval based on the event stream and determining a pixel value of each pixel based on the accumulated events associated with the pixel;
- and
- inputting the event image to a gaze-estimation machine learning model, which generates a first prediction output regarding a direction of the user's eye movement and a second prediction output regarding a speed of the user's eye movement.
A non-transitory computer readable storage medium storing instructions which, when executed by a processor, causes the processor to perform a method, the method comprising:
- obtaining an event stream captured by an event camera monitoring movement of a user's eye;
- generating an event image by accumulating, at a pixel level, events that occurred within a predetermined interval based on the event stream and determining a pixel value of each pixel based on the accumulated events associated with the pixel;
- and
- inputting the event image to a gaze-estimation machine learning model, which generates a first prediction output regarding a direction of the user's eye movement and a second prediction output regarding a speed of the user's eye movement.
A computer system, comprising:
- a processor;
- and
- a storage device coupled to the processor, wherein the storage device storing instructions which, when executed by the processor, cause the processor to perform a method, the method comprising:
- obtaining an event stream captured by an event camera monitoring movement of a user's eye;
- generating an event image by accumulating, at a pixel level, events that occurred within a predetermined interval based on the event stream and determining a pixel value of each pixel based on the accumulated events associated with the pixel;
- and
- inputting the event image to a gaze-estimation machine learning model, which generates a first prediction output regarding a direction of the user's eye movement and a second prediction output regarding a speed of the user's eye movement.
Dependencies are inferred from the claim text.