# US 2021/0344897 A1 · Method and system for tracking eye movement in conjunction with a light scanning projector

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344897 A1
- Document ID: US20210344897A1
- Status: Published application
- Kind: A1
- Application number: 17/306,732
- Filed: 2021-05-03
- Published: 2021-11-04
- Earliest claimed: 2017-03-21
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Brian T. Schowengerdt; Mathew D. Watson; Samuel Scott Frank; Charles David Melville
- Web page: https://patentgrep.com/patent/US20210344897A1

## CPC

- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- H04N 9/3129: {scanning a light beam on the display screen (scanning a light beam on a screen in displays other than projection devices G09G3/02; scanning systems in general G02B26/10; projectors using laser light sources in general H04N9/3161)}
- H04N 13/344: with head-mounted left-right displays
- G02B 2027/0123: {comprising devices increasing the field of view}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02C 11/10: {Electronic devices other than hearing aids}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)

## Abstract

An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

## Claims

### Claim 1

An eye tracking system comprising:
a light scanning projector;
an eyepiece optically coupled to the light scanning projector;
an optical sensor; and
an image processor coupled to the light scanning projector and the optical sensor.

### Claim 2 (depends on 1)

The eye tracking system of claim 1 wherein the light scanning projector comprises a fiber scanning projector configured to scan in a spiral pattern with an increasing angular deflection as a function of time during an image frame.

### Claim 3 (depends on 1)

The eye tracking system of claim 1 further comprising glasses having a frame, wherein the light scanning projector, the eyepiece, and the optical sensor are mounted in the frame.

### Claim 4 (depends on 1)

The eye tracking system of claim 1 wherein the eyepiece comprises a plurality of planar waveguides.

### Claim 5 (depends on 4)

The eye tracking system of claim 4 wherein the plurality of planar waveguides comprise four planar waveguides.

### Claim 6 (depends on 1)

The eye tracking system of claim 1, wherein the eyepiece comprises a diffractive reflector operable to diffract one or more time-varying reflected signals to the optical sensor.

### Claim 7 (depends on 1)

The eye tracking system of claim 1 wherein the optical sensor comprises a photodetector.

### Claim 8 (depends on 1)

The eye tracking system of claim 1 wherein the light scanning projector is operable to output a display signal and a characterization signal.

### Claim 9 (depends on 8)

The eye tracking system of claim 8 wherein the display signal comprises one or more visible wavelengths and the characterization signal comprises one or more non-visible wavelengths.

### Claim 10 (depends on 9)

The eye tracking system of claim 9 wherein the one or more visible wavelengths comprise red, green, and blue wavelengths and the one or more non-visible wavelengths comprise infrared wavelengths.

### Claim 11 (depends on 10)

The eye tracking system of claim 10 wherein the eyepiece comprises a plurality of planar waveguides including:
a first planar waveguide corresponding to red wavelengths;
a second planar waveguide corresponding to green wavelengths;
a third planar waveguide corresponding to blue wavelengths; and
a fourth planar waveguide corresponding to infrared wavelengths.

### Claim 12

A method of operating an eye tracking system including a light scanning projector, an eyepiece, and an optical sensor, the method comprising:
generating, using the light scanning projector, an optical signal;
coupling at least a portion of the optical signal into the eyepiece;
projecting, from the eyepiece, an image viewable by an eye of a user;
detecting, using the optical sensor, light reflected from the eye of the user; and
tracking a position of the eye of the user.

### Claim 13 (depends on 12)

The method of claim 12 wherein the light scanning projector comprises a fiber scanning projector configured to scan in a spiral pattern with an increasing angular deflection as a function of time during the image.

### Claim 14 (depends on 12)

The method of claim 12 wherein the optical signal comprises a display signal and a characterization signal.

### Claim 15 (depends on 14)

The method of claim 14 wherein the display signal comprises one or more visible wavelengths and the characterization signal comprises one or more non-visible wavelengths.

### Claim 16 (depends on 15)

The method of claim 15 wherein the one or more visible wavelengths comprise red, green, and blue wavelengths and the one or more non-visible wavelengths comprise infrared wavelengths.

### Claim 17 (depends on 12)

The method of claim 12 wherein the eyepiece comprises a plurality of planar waveguides.

### Claim 18 (depends on 17)

The method of claim 17 wherein the plurality of planar waveguides comprise four planar waveguides.

### Claim 19 (depends on 12)

The method of claim 12 wherein the optical sensor comprises a photodetector.

### Claim 20 (depends on 12)

The method of claim 12 wherein tracking the position of the eye of the user comprises correlating a position of a series of pixels of the image with a series of intensities of the light reflected from the eye of the user.
