Corrected Gaze Direction and Origin

A method, comprising:

• performing, by a controller comprising one or more processors:
• obtaining a model of an eye including an optical axis and an entrance pupil;
• receiving one or more images of the eye captured by an eye-facing camera when the eye is looking at a target prompt on a display;
• determining, from the one or more images, a difference on the display between a gaze direction of the eye when looking at the target prompt and the optical axis;
• and
• determining a visual axis for the eye based on the determined difference and the model of the eye.

A system, comprising:

• a head-mounted device (HMD), comprising:
• a display configured to be positioned in front of an eye;
• an eye-facing camera configured to capture images of the eye;
• a point of view (PoV) camera configured to capture video of an environment in front of the device;
• and
• a controller comprising one or more processors configured to:
• generate a model of the eye including an optical axis and an entrance pupil based on images of the eye captured by the eye-facing camera;
• determine a visual axis for the eye based on a difference between a gaze direction of the eye when looking at a target prompt on the display and the optical axis;
• generate and display virtual content based on content of the video captured by the POV camera and the eye model;
• and
• determine a position on the display at which the eye is looking according to the visual axis.