# US 2023/0057514 A1 · Differential illumination for corneal glint detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0057514 A1
- Document ID: US20230057514A1
- Status: Published application
- Kind: A1
- Application number: 17/576,548
- Filed: 2022-01-14
- Published: 2023-02-23
- Earliest claimed: 2021-08-18
- Assignees: Meta Platforms Technologies, LLC
- Applicants: Meta Platforms Technologies, LLC
- Inventors: Alexander Jobe Fix; Clare Joyce Robinson; Mohammadhossein Daraeihajitooei; Timo Stoffregen
- Web page: https://patentgrep.com/patent/US20230057514A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/73: using feature-based methods
- G06V 10/141: Control of illumination
- G06V 40/19: Sensors therefor
- G06V 40/193: {Preprocessing; Feature extraction}
- H04N 23/56: provided with illuminating means
- G06T 2207/10048: Infrared image
- G06T 2207/10152: Varying illumination
- G06T 2207/30041: Eye; Retina; Ophthalmic
- G06T 2207/30201: Face
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus, system, and method for detecting glints includes a pair of light sources positioned on a head-mounted frame and driven to illuminate a corneal surface of an eye with differential light signals. An image sensor is positioned on the head-mounted frame to receive reflections of the differential light signals from the corneal surface. An orientation of a cornea (e.g., corneal sphere) of the eye may be determined at least partially based on the reflections of the differential light signals.

## Claims

### Claim 1

A glint detection system comprising:
a pair of light sources positioned on a head-mounted frame to illuminate a corneal surface of an eye with differential light signals;
an image sensor positioned on the head-mounted frame to receive reflections of the differential light signals from the eye; and
processing logic coupled to the pair of light sources and to the image sensor, wherein the processing logic drives the pair of light sources to emit the differential light signals, wherein the processing logic receives, from the image sensor, image data that is representative of the reflections of the differential light signals, wherein the processing logic determines an orientation of a cornea of the eye at least partially based on the image data.

### Claim 2 (depends on 1)

The glint detection system of claim 1, wherein the image sensor is responsive to changes in brightness in a field of view of the image sensor, wherein the image data is representative of the changes in brightness.

### Claim 3 (depends on 1)

The glint detection system of claim 1, wherein an integration of a plurality of the reflections of the differential light signals produces a first cluster of pixels and a second cluster of pixels, wherein a first of the pair of light sources is positioned a distance from a second of the pair of light sources so the first cluster of pixels is adjacent to the second cluster of pixels.

### Claim 4 (depends on 3)

The glint detection system of claim 3, wherein the first cluster of pixels nearly touches the second cluster of pixels in an image map representation of the integration of the plurality of the reflections of the differential light signals.

### Claim 5 (depends on 1)

The glint detection system of claim 1, wherein the image sensor is an event camera that is responsive to changes in brightness in a field of view of the image sensor.

### Claim 6 (depends on 1)

The glint detection system of claim 1, wherein the differential light signals represent square-wave patterns of opposite polarity.

### Claim 7 (depends on 1)

The glint detection system of claim 1, wherein the pair of light sources emit infrared light.

### Claim 8 (depends on 1)

The glint detection system of claim 1, wherein the light sources emit a pattern at an illumination frequency of at least 1 kHz.

### Claim 9 (depends on 1)

The glint detection system of claim 1, wherein a first duty cycle of a pattern emitted by a first of the pair of light sources matches a second duty cycle of a pattern emitted by a second of the pair of light sources.

### Claim 10 (depends on 1)

The glint detection system of claim 1, wherein a first duty cycle of a first of the pair of light sources is less than 50% and a second duty cycle of a second of the pair of light sources is greater than 50% so that a sum of the first and second duty cycles is approximately 100%.

### Claim 11 (depends on 1)

The glint detection system of claim 1 further comprising:
one or more additional pairs of light sources positioned on the head-mounted frame to illuminate the corneal surface of the eye with one or more additional differential light signals.

### Claim 12 (depends on 1)

The glint detection system of claim 1, wherein an intra-light source angle between the pair of light sources is at least 2.5 degrees.

### Claim 13 (depends on 1)

The glint detection system of claim 1, wherein the pair of light sources are light emitting diodes (LEDs), vertical external-cavity surface-emitting lasers (VCSELs), fiber optics, or out-coupling gratings.

### Claim 14

A head mounted display comprising:
a display to provide display light;
a lens assembly to transmit the display light from the display to an eyebox; and
a glint detection system comprising:
a pair of light sources positioned on a head-mounted frame to illuminate a corneal surface of an eye with differential light signals;
an image sensor positioned on the head-mounted frame to receive reflections of the differential light signals from the eye; and
processing logic coupled to the pair of light sources and to the image sensor, wherein the processing logic drives the pair of light sources to emit the differential light signals, wherein the processing logic receives, from the image sensor, image data that is representative of the reflections of the differential light signals, wherein the processing logic determines an orientation of a cornea of the eye at least partially based on the image data.

### Claim 15 (depends on 14)

The head mounted display of claim 14, wherein the image sensor is responsive to changes in brightness in a field of view of the image sensor, wherein the image data is representative of the changes in brightness.

### Claim 16 (depends on 14)

The head mounted display of claim 14, wherein the image sensor is an event camera.

### Claim 17 (depends on 14)

The head mounted display of claim 14, wherein the differential light signals include square wave patterns that repeat at a frequency of at least 1 kHz.

### Claim 18

A method of corneal glint detection using differential lighting comprising:
driving a pair of light sources to emit differential light signals towards an eye of a user;
receiving image data from an image sensor, wherein the image data is representative of reflections of the differential light signals off of the eye of the user; and
determining an orientation of a corneal sphere of the eye at least partially based on the image data.

### Claim 19 (depends on 18)

The method of claim 18, wherein driving the pair of light sources includes driving the pair of light sources to emit square waves having opposite polarities.

### Claim 20 (depends on 18)

The method of claim 18, wherein the image sensor is an event sensor configured to capture events from each pixel having a digital pixel value that exceeds a threshold.
