System and method for hybrid eye tracker
AssigneeSamsung Electronics Co., Ltd.
InventorsFannie Fontanel, Sajid Sadi
Life of this patent
Estimating the term…
Abstract
A system and method enable an electronic device to perform gaze tracking operations. The electronic device includes one or more cameras and at least one processor. The one or more cameras include a Dynamic Vision Sensor (DVS) camera. The one or more cameras are configured to capture features of an eye of a wearer of the electronic device The processor is configured to receive, from the one or more cameras, an image or pixel stream associated with the eye, determine an initial pose of the eye based on the image or pixel stream, receive DVS pixel data from the DVS camera, track one or more changes to the initial pose of the eye based on the DVS pixel data, and based on the one or more changes to the initial pose of the eye, determine a gaze of the wearer.
Claims20
An electronic device comprising:
- one or more cameras configured to capture pixel changes from of an eye of a wearer of the electronic device, the one or more cameras comprising at least one Dynamic Vision Sensor (DVS) camera;
- and
- one or more processors configured to:
- receive, from the one or more cameras, information associated with the eye,
- initialize an initial pose of the eye based on the information,
- receive DVS pixel data from the at least one DVS camera,
- track one or more changes to the initial pose of the eye based on the DVS pixel data, and
- based on the one or more changes to the initial pose of the eye, determine a gaze of the wearer.
A method comprising:
- capturing, by one or more cameras configured to capture, pixel changes from an eye of a wearer of an electronic device, the one or more cameras comprising at least one Dynamic Vision Sensor (DVS) camera;
- receiving, from one or more cameras, information associated with the eye,
- initializing an initial pose of the eye based on the information;
- receiving DVS pixel data from the at least one DVS camera,
- tracking one or more changes to the initial pose of the eye based on the DVS pixel data;
- and
- determining a gaze of the wearer based on the one or more changes to the initial pose of the eye.
A non-transitory computer readable medium configured to store a plurality of instructions that, when executed by at least one processor, are configured to cause the at least one processor to:
- receive, from one or more cameras configured to capture pixel changes from of an eye of a wearer of an electronic device, the one or more cameras comprising at least one DVS camera, information associated with the eye;
- initialize an initial pose of the eye based on the information;
- receive DVS pixel data from the at least one DVS camera;
- track one or more changes to the initial pose of the eye based on the DVS pixel data;
- and
- determine a gaze of the wearer based on the one or more changes to the initial pose of the eye.
Dependencies are inferred from the claim text.