# US 10,375,326 B2 · Gaze tracking variations using selective illumination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,326 B2
- Document ID: US10375326B2
- Status: Granted
- Kind: B2
- Application number: 15/713,466
- Filed: 2017-09-22
- Published: 2018-01-11
- Granted: 2019-08-06
- Earliest claimed: 2013-09-24
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Eric J. Larsen
- Web page: https://patentgrep.com/patent/US10375326B2

## CPC

- G06V 40/19: Sensors therefor
- H04N 23/20: for generating image signals from infrared radiation only
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/74: by influencing the scene brightness using illuminating means
- G06V 10/141: Control of illumination
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Aspects of the present disclosure relate to eye tracking systems and methods which track eyes by illuminating the eyes using a light source and detecting the eye illuminations using a sensor. Implementations of the present disclosure may utilize wide angle lighting via a plurality of individual light sources which are each oriented in different orientations. A wide area may be illuminated by the different light sources, and these light sources may be selectively turned on and off based on a current location of a user.

## Claims

### Claim 1

A method comprising:
emitting light from an eye tracking device, wherein said emitting the light includes initially emitting the light from all light sources of a plurality of light sources of the eye tracking device, each said light source of the plurality being oriented to emit light at a different angle;
detecting an area illuminated by the light with a sensor of the eye tracking device;
identifying one or more of the light sources of the plurality as contributing light sources from analysis of data gathered from said detecting the area, said identifying the light sources as the contributing light sources being based on a determination that the contributing light sources illuminate one or more eyes, wherein identifying one or more of the lights sources of the plurality as contributing light sources comprises pulsing one or more of the plurality at a different pulse frequency than a pulse frequency of the rest of the light sources of the plurality and detecting the presence of reflections at the different pulse frequency or the pulse frequency of the rest of the light sources of the plurality;
turning off one or more light sources of the plurality not identified as the contributing light sources while emitting the light from the contributing light sources.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the sensor is a camera,
wherein the data is one or more images, and
wherein said detecting the area includes capturing the images with the camera.

### Claim 3 (depends on 1)

The method of claim 1,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein said identifying the contributing light sources includes identifying a location of one or more illuminated eyes within the images and identifying the contributing light sources based on correspondence between the location and known orientations of each said light source.

### Claim 4 (depends on 1)

The method of claim 1,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein the method further comprises, after said turning off the light sources, analyzing the images to determine one or more gaze characteristics of the one or more eyes illuminated by said emitting the light.

### Claim 5 (depends on 1)

The method of claim 1,
wherein each said light source is an infrared LED,
wherein the sensor is an infrared camera,
wherein the data is one or more infrared images, and
wherein said detecting the area includes capturing the infrared images with the infrared camera.

### Claim 6 (depends on 1)

The method of claim 1, wherein said turning off the light sources includes sending a control signal to the eye tracking device which causes said turning off of the light sources.

### Claim 7

A system comprising:
an eye tracking device having a sensor and a plurality of light sources, each said light source being oriented to emit light at a different angle; and
a computing device, wherein the system is configured to perform a method, the method comprising:
emitting light from the eye tracking device, wherein said emitting the light includes initially emitting the light from all light sources of the plurality of light sources;
detecting an area illuminated by the light with the sensor;
identifying, with the computing device, one or more of the light sources of the plurality as contributing light sources from analysis of data gathered from said detecting the area, said identifying the light sources of the plurality as the contributing light sources being based on a determination that the contributing light sources illuminate one or more eyes, wherein identifying one or more of the lights sources of the plurality as contributing light sources comprises pulsing one or more of the plurality at a different pulse frequency than a pulse frequency of the rest of the light sources of the plurality and detecting the presence of reflections at the different pulse frequency or the pulse frequency of the rest of the light sources of the plurality;
turning off one or more light sources of the plurality not identified as the contributing light sources while emitting the light from the contributing light sources.

### Claim 8 (depends on 7)

The system of claim 7, wherein each said light source is an infrared LED.

### Claim 9 (depends on 7)

The system of claim 7, wherein each said light source is an infrared LED, wherein each said infrared LED is fixed to a casing of the eye tracking device at a different angle, wherein each infrared LED is configured to emit light in a different non-overlapping region in front of the eye tracking device.

### Claim 10 (depends on 7)

The system of claim 7,
wherein the sensor is a camera,
wherein the data is one or more images, and
wherein said detecting the area includes capturing the images with the camera.

### Claim 11 (depends on 7)

The system of claim 7,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein said identifying the contributing light sources includes identifying a location of one or more illuminated eyes within the images and identifying the contributing light sources based on correspondence between the location and known orientations of each said light source.

### Claim 12 (depends on 7)

The system of claim 7,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein the method further comprises, after said turning off the light sources, analyzing the images to determine one or more gaze characteristics of the one or more eyes illuminated by said emitting the light.

### Claim 13 (depends on 7)

The system of claim 7,
wherein each said light source is an infrared LED,
wherein the sensor is an infrared camera,
wherein the data is one or more infrared images, and
wherein said detecting the area includes capturing the infrared images with the infrared camera.

### Claim 14 (depends on 7)

The system of claim 7, wherein said turning off the light sources includes sending a control signal from the computing device to the eye tracking device which causes said turning off of the light sources.

### Claim 15

A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to perform a method, the method comprising:
emitting light from an eye tracking device, wherein said emitting the light includes initially emitting the light from all light sources of a plurality of light sources of the eye tracking device, each said light source being oriented to emit light at a different angle;
detecting an area illuminated by the light with a sensor of the eye tracking device;
identifying one or more of the light sources of the plurality as contributing light sources from analysis of data gathered from said detecting the area, said identifying the one or more light sources of the plurality as the contributing light sources being based on a determination that the contributing light sources illuminate one or more eyes, wherein identifying one or more of the lights sources of the plurality as contributing light sources comprises pulsing one or more of the plurality at a different pulse frequency than a pulse frequency of the rest of the light sources of the plurality and detecting the presence of reflections at the different pulse frequency or the pulse frequency of the rest of the light sources of the plurality;
turning off one or more light sources of the plurality not identified as the contributing light sources while emitting the light from the contributing light sources.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15,
wherein the sensor is a camera,
wherein the data is one or more images, and
wherein said detecting the area includes capturing the images with the camera.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein said identifying the contributing light sources includes identifying a location of one or more illuminated eyes within the images and identifying the contributing light sources based on correspondence between the location and known orientations of each said light source.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15,
wherein the sensor is a camera,
wherein the data is one or more images,
wherein said detecting the area includes capturing the images with the camera, and
wherein the method further comprises, after said turning off the light sources, analyzing the images to determine one or more gaze characteristics of the one or more eyes illuminated by said emitting the light.

### Claim 19 (depends on 15)

The non-transitory computer readable medium of claim 15,
wherein each said light source is an infrared LED,
wherein the sensor is an infrared camera,
wherein the data is one or more infrared images, and
wherein said detecting the area includes capturing the infrared images with the infrared camera.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein said turning off the light sources includes sending a control signal to the eye tracking device which causes said turning off of the light sources.
