Eye tracking calibration techniques
AssigneeMagic Leap, Inc.
InventorsBenjamin Joseph Uscinski, Yan Xu, Bradley Vincent Stuart
Life of this patent
Estimating the term…
Abstract
Systems and methods for eye tracking calibration in a wearable system are described. The wearable system can present three-dimensional (3D) virtual content and allow a user to interact with the 3D virtual content using eye gaze. During an eye tracking calibration, the wearable system can validate that a user is indeed looking at a calibration target while the eye tracking data is acquired. The validation may be performed based on data associated with the user's head pose and vestibulo-ocular reflex.
Claims20
A wearable system for eye tracking calibration comprising:
- an image capture device configured to capture eye images of one or two eyes of a user of the wearable system;
- non-transitory memory configured to store the eye images;
- a display system through which the user can perceive a virtual reticle and a virtual eye calibration target in an environment of the user;
- a pose sensor configured to track a head pose of the user;
- a hardware processor in communication with the non-transitory memory and the display system, the hardware processor programmed to:
- cause the virtual eye calibration target to be perceivable via the display system;
- cause the virtual reticle to be rendered via the display system;
- determine a current head pose of the user based on data acquired from the pose sensor;
- calculate a location of the virtual reticle based on the current head pose;
- cast a virtual geometric cone through the location of the virtual reticle;
- detect a collision of the virtual geometric cone and the virtual eye calibration target in response to at least a threshold portion of the virtual eye calibration target falling within a volume of the virtual geometric cone;
- determine whether the virtual reticle aligns with the virtual eye calibration target based at least partly on the detected collision;
- and
- in response to a determination that the virtual reticle aligns with the virtual eye calibration target, initiate storage of the eye images into the non-transitory memory.
A method for eye tracking calibration comprising:
- under control of a hardware processor:
- identifying a virtual eye calibration target in a world space associated with an environment of a user;
- instructing a wearable device of the user to render a representation of a virtual reticle in a rig space associated with the wearable device of the user;
- obtaining head pose data of the user;
- determining a current head pose of the user based on the obtained head pose data;
- calculating a position of the virtual reticle based on the determined head pose;
- casting a virtual geometric cone through the location of the virtual reticle;
- detecting a collision of the virtual geometric cone and the virtual eye calibration target, the collision comprising a portion of the virtual eye calibration target falling within a volume of the virtual geometric cone;
- determining whether the virtual reticle aligns with the virtual eye calibration target based at least in part on the detected collision;
- and
- in response to a determination that the virtual reticle aligns with the virtual eye calibration target, instructing an inward-facing imaging system of the wearable device to acquire eye calibration data.
Dependencies are inferred from the claim text.