Computational array camera with dynamic illumination for eye tracking
AssigneeIntel Corporation
InventorsNizan Horesh, Amir Bousany
Life of this patent
Estimating the term…
Abstract
Methods and systems for eye tracking are disclosed. One such method obtains a plurality of images of the eye from an array camera and detects glint positions and a pupil edge of the eye in the plurality of the images. A distance from the array camera to the pupil edge may be estimated based on the glint positions. A pupil image may be generated based on selected ones of the plurality of images, the glint positions, and the estimated distance to the pupil edge. A pupil center position may be determined based on the pupil image and the glint positions.
Claims20
A processor implemented method for eye tracking, the method comprising:
- obtaining, from an array camera, a plurality of images of an eye comprising glints as generated by an illumination pattern;
- detecting a pupil edge in the plurality of images;
- determining a subset of light sources that reduces interference of the glints with the pupil edge while keeping a plurality of glints including:
- selecting light sources that produce glints that interfere with the pupil edge;
- and
- deactivating the selected light sources;
- estimating a center of the pupil from the plurality of glints and the pupil edge represented in images from the plurality of images captured using the subset of light sources;
- and
- tracking a gaze vector based on the estimate of the center of the pupil.
A non-transitory machine-readable medium comprising instructions for eye tracking, which when executed by a machine, cause the machine to:
- obtain, from an array camera, a plurality of images of an eye comprising glints as generated by an illumination pattern;
- detect a pupil edge in the plurality of images;
- determine a plurality of light sources that reduces interference of the glints with the pupil edge while keeping a plurality of glints including:
- selection of light sources that produce glints that interfere with the pupil edge;
- and
- deactivation of the selected light sources;
- estimate a center of the pupil from the plurality of glints and the pupil edge represented in images from the plurality of images captured using the subset of light sources;
- and
- track a gaze vector based on the estimate of the center of the pupil.
An eye tracking system comprising:
- an array camera to generate a plurality of images of the eye;
- a plurality of light sources to generate an illumination pattern represented by a glint pattern on the eye;
- and
- a processing unit, coupled to the array camera and the plurality of light sources, to:
- obtain the plurality of images;
- detect a pupil edge in the plurality of images;
- determine a subset of light sources of the plurality of light sources that reduces interference of the glints with the pupil edge while keeping a plurality of glints including:
- selection of light sources that produce glints that interfere with the pupil edge;
- and
- deactivation of the selected light sources;
- and
- estimate a center of the pupil from the plurality of glints and the pupil edge represented in images from the plurality of images captured using the subset of light sources, and track a gaze vector based on the estimate of the center of the pupil.
Dependencies are inferred from the claim text.