Multi-view based eyeball fitting for single view gaze prediction

An apparatus for extended reality (XR), the apparatus comprising:

• at least one memory;
• and
• at least one processor coupled to the at least one memory and configured to:
• obtain a first two-dimensional (2D) image at a first pose of an XR device;
• unproject a first ellipse contour on the first 2D image into a three-dimensional (3D) space to generate a first cone;
• obtain a second 2D image at a second pose of the XR device;
• unproject a second ellipse contour on the second 2D image into the 3D space to generate a second cone, wherein the first ellipse contour and the second ellipse contour are associated with a pupil of an eye of a user wearing the XR device;
• and
• determine, based on an intersection of the first cone and the second cone, a location of a center of the pupil of the eye of the user.

An apparatus for extended reality (XR), the apparatus comprising:

• at least one memory;
• and
• at least one processor coupled to the at least one memory and configured to:
• determine, based on a respective normal vector for each contour of a plurality of contours, an intersection of the respective normal vectors, wherein each contour of the plurality contours is associated with a respective gaze of a pupil of an eyeball of a user wearing an XR device;
• and
• determine, based on the intersection of the respective normal vectors, a center of the eyeball of the user.