US 8,998,414 B2 · Integrated eye tracking and display system

Abstract

Technology is provided for an integrated eye tracking and display system for a see-through, near-eye, mixed reality display device. Image data and IR illumination for eye tracking are optically coupled into a respective see-through, planar waveguide positioned to be seen through by each eye in a respective display optical system of the display device. The respective planar waveguide comprises one or more wavelength selective filters positioned to be co-axial with an optical axis of the respective display optical system. The wavelength selective filters direct IR and visible illumination out of the planar waveguide in the direction of the respective eye and direct IR reflections, including reflections from the eye, into the planar waveguide. The reflections are optically coupled out of the waveguide to an IR sensor which generates eye tracking data based on the reflections.

Claims12

Dependent claims

An integrated eye tracking and display system for a near-eye, mixed reality display device comprising:

a display optical system positioned to be seen through by an eye by the near-eye, mixed reality display device, the display optical system having an optical axis and a planar waveguide;
one or more wavelength selective filters positioned in the planar waveguide in co-axial alignment with the optical axis of the display optical system for directing infrared and visible illumination out of the planar waveguide in the direction of the eye and for directing infrared reflections from the eye into the planar waveguide;
and
an integrated array of optical elements including light sources interspersed with one or more infrared sensors, the light sources being for transmitting infrared and visible illumination, the light sources being optically coupled to the planar waveguide for directing their illumination into the planar waveguide, and the one or more infrared sensors of the integrated array being optically coupled to the planar waveguide for receiving infrared reflections directed from the one or more wavelength selective filters.

1 more element

A method for processing visible and infrared wavelengths for image display and eye tracking in a display optical system of a near-eye, mixed reality display device comprising:

optically coupling visible and infrared illumination from an integrated array of optical elements including visible and infrared light sources interspersed with one or more infrared sensors into a planar waveguide positioned in the display optical system to be seen through by an eye in a first direction of an optical path of the planar waveguide;
directing the visible and infrared illumination toward an eye out of the planar waveguide by one or more wavelength selective filters co-axially aligned with an optical axis of the display optical system;
directing infrared reflections from the eye by the one or more wavelength selective filters into the planar waveguide in a second direction of the same optical path;
optically coupling the infrared reflections from the planar waveguide to the one or more infrared sensors of the integrated array of optical elements;
and
storing data generated by the one or more infrared sensors as eye tracking data.

3 more elements

Dependencies are inferred from the claim text.

Integrated eye tracking and display system

Life of this patent

Integrated eye tracking and display system

Life of this patent

Abstract

Claims12