Back to results
US 10,948,981 B2Granted
Method and system for eye tracking using speckle patterns
AssigneeMagic Leap, Inc.
InventorsAsif Sinay, Barak Freedman, Evyatar Bluzer
Life of this patent
Estimating the term…
Abstract
A method of tracking movement of an eye of a user includes directing a light beam at the eye. The eye may reflect a portion of the light beam. The method further includes detecting a plurality of speckle patterns formed at a detector by the portion of the light beam reflected by the eye. The plurality of speckle patterns may be detected at a predetermined frame rate. The method further includes tracking movement of the eye by tracking the plurality of speckle patterns from frame to frame.
Claims19
A method of tracking movement of an eye gaze of a user, the method comprising:
- recording a video image of an eye of the user using a camera, the video image showing movement of a pupil of the eye;
- determining a starting eye gaze based on the video image of the eye, the starting eye gaze characterized by coordinates of a center of the pupil relative to a pre-calibrated origin;
- in response to determining the starting eye gaze:
- propagating a light beam directly from a light source onto the eye;
- detecting a speckle pattern formed on a detector by a portion of the light beam reflected by the eye, the speckle pattern being detected at a predetermined frame rate;
- and
- tracking movement of the eye gaze relative to the starting eye gaze by tracking the speckle pattern from frame to frame;
- determining that the eye has blinked;
- determining a new starting eye gaze by:
- recording a second video image of the eye using the camera;
- and
- determining the new starting eye gaze based on the second video image of the eye;
- and
- tracking movement of the eye gaze relative to the new starting eye gaze by:
- detecting a second speckle pattern formed at the detector;
- and
- tracking the second speckle pattern from frame to frame.
14 more elements
A method of tracking a gaze of an eye of a user, the method comprising:
- recording a first video image of the eye using a camera at a first frame rate, the first video image showing movement of a pupil of the eye;
- determining a starting gaze of the eye based on the first video image of the eye, the starting gaze characterized by coordinates of a center of the pupil relative to a pre-calibrated origin;
- in response to determining the starting gaze of the eye:
- propagating a light beam directly from a light source onto the eye;
- detecting a first speckle pattern formed at a detector by a portion of the light beam reflected by the eye, the first speckle pattern being detected at a second frame rate greater than the first frame rate;
- and
- tracking movement of the gaze of the eye relative to the starting gaze of the eye by tracking the first speckle pattern from frame to frame;
- determining that the eye has blinked;
- determining a new starting gaze of the eye by:
- recording a second video image of the eye using the camera;
- and
- determining the new starting gaze of the eye based on the second video image of the eye;
- and
- tracking movement of the gaze of the eye relative to the new starting gaze of the eye by:
- detecting a second speckle pattern formed at the detector at the second frame rate;
- and
- tracking the second speckle pattern from frame to frame.
14 more elements
A method of tracking movement of an eye gaze of a user, the method comprising:
- recording a video image of an eye of the user using a camera, the video image showing movement of a pupil of the eye;
- determining a starting eye gaze based on the video image of the eye, the starting eye gaze characterized by coordinates of a center of the pupil relative to a pre-calibrated origin;
- in response to determining the starting eye gaze:
- illuminating an eye with coherent light at a slanted angle relative to the eye;
- propagating a portion of the coherent light scattered by the eye from the eye to an image sensor;
- detecting a speckle pattern formed on the image sensor by the portion of the coherent light scattered by the eye, the speckle pattern being detected at a predetermined frame rate;
- and
- tracking movement of the eye gaze relative to the staring eye gaze by tracking the speckle pattern from frame to frame;
- determining that the eye has blinked;
- determining a new starting eye gaze by:
- recording a second video image of the eye using the camera;
- and
- determining the new starting eye gaze based on the second video image of the eye;
- and
- tracking movement of the eye gaze relative to the new starting eye gaze by:
- detecting a second speckle pattern formed at image sensor;
- and
- tracking the second speckle pattern from frame to frame.
15 more elements
Dependencies are inferred from the claim text.