# US 10,313,587 B2 · Power management in an eye-tracking system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,587 B2
- Document ID: US10313587B2
- Status: Granted
- Kind: B2
- Application number: 15/831,511
- Filed: 2017-12-05
- Published: 2018-04-12
- Granted: 2019-06-04
- Earliest claimed: 2011-10-27
- Assignees: Tobii AB
- Applicants: Tobii AB
- Inventors: Henrik Eskilsson; Mårten Skogö; John Elvesjö; Peter Blixt
- Web page: https://patentgrep.com/patent/US10313587B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G02B 27/0172: {characterised by optical features}
- G06V 40/18: Eye characteristics, e.g. of the iris
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G09G 2330/021: Power management, e.g. power saving
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An imaging device adapted to provide eye-tracking data by imaging at least one eye of a viewer, wherein: the imaging device is switchable between at least an active mode and a ready mode; the imaging device is configured, in the active mode, to use active eye illumination, which enables tracking of a corneal reflection, and to provide eye tracking data which include eye position and eye orientation; and the imaging device is configured, in the ready mode, to reduce an illumination intensity from a value the illumination intensity has in the active mode.

## Claims

### Claim 1

An imaging device adapted to provide data measurements by imaging at least one eye of a viewer, wherein:
the data measurements describe one or more of eye position or eye orientation;
the imaging device is switchable between at least an active mode and a ready mode;
the imaging device is configured, in the active mode, to maintain a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate;
the imaging device is configured, in the ready mode, to maintain a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and
upon switching to the active mode from the ready mode, the imaging device provides additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

### Claim 2 (depends on 1)

The imaging device of claim 1, wherein the first criteria further include one or more of:
data estimating camera-to-eye distance,
data indicating multiple distinct tracked eye features,
camera data having a resolution reduced by a relatively low binning ratio,
data received from multiple cameras, or
a particular eye position and a particular eye orientation.

### Claim 3 (depends on 2)

The imaging device of claim 2, wherein the first criteria further include camera data having a full resolution.

### Claim 4 (depends on 1)

The imaging device of claim 1, wherein the second criteria further include one or more of:
data indicating a single distinct tracked eye feature,
camera data having a resolution reduced by a relatively high binning ratio,
data received from a single camera, or
a particular eye position without a particular eye orientation.

### Claim 5 (depends on 1)

The imaging device of claim 1, wherein the second result history includes data measurements based on partially processed data.

### Claim 6 (depends on 1)

The imaging device of claim 1, wherein, in the ready mode, the data gathered based on the second criteria relates to an eye location in an image plane but not in world coordinates.

### Claim 7 (depends on 1)

The imaging device of claim 1, wherein the imaging device is configured to activate, from a group of light sources:
in the active mode, multiple light sources from the group of light sources, and
in the ready mode, a single light source from the group of light sources.

### Claim 8 (depends on 1)

The imaging device of claim 1, wherein the imaging device is configured to pre-process optical data by binning at a higher binning ratio in the ready mode than in the active mode.

### Claim 9 (depends on 1)

The imaging device of claim 1, wherein the imaging device is switchable between the active mode, the ready mode and an idle mode, and wherein a switching time from the idle mode to the active mode is longer than a switching time from the ready mode to the active mode.

### Claim 10 (depends on 1)

A personal computer system comprising:
the imaging device of claim 1;
a visual display; and
an input device for accepting eye-tracking control data and other input data.

### Claim 11 (depends on 10)

The personal computer system of claim 10, wherein the input device includes:
at least one dedicated input device adapted to accept the eye-tracking control data only; and
at least one general-purpose input device adapted to accept the other input data.

### Claim 12 (depends on 11)

The personal computer system of claim 11, wherein the imaging device operates in the active mode based on an input received from the dedicated input device.

### Claim 13 (depends on 12)

The personal computer system of claim 12, wherein the imaging device changes operation to the active mode based on an interrupt triggered by the input received from the dedicated input device.

### Claim 14 (depends on 11)

The personal computer system of claim 11, wherein the dedicated input device is a hardware touch-actuated input device, and the imaging device operates in an idle mode based on an input received from the hardware touch-actuated input device.

### Claim 15 (depends on 14)

The personal computer system of claim 14, wherein:
the imaging device is selectively connected to a drive power; and
the imaging device changes operation to the idle mode based on the input received from the hardware touch-actuated input device disconnecting the imaging device from said drive power.

### Claim 16 (depends on 10)

The personal computer system of claim 10, further comprising a viewer presence detector configured to provide at least one of:
a positive detection signal, wherein the imaging device switches into the ready mode from an idle mode based on the positive detection signal, or
a negative detection signal, wherein the imaging device switches into the idle mode from either the active mode or the ready mode based on the negative detection signal.

### Claim 17 (depends on 16)

The personal computer system of claim 16, wherein:
the viewer presence detector is a proximity sensor at a push button and is arranged to sense proximity of a finger; and
the proximity sensor is configured to provide the positive detection signal causing the image device to switch into the ready mode from the idle mode.

### Claim 18

A method in an imaging device adapted to provide data measurements by imaging at least one eye of a viewer,
wherein the data measurements describe one or more of eye position or eye orientation;
wherein said method comprises the steps of:
switching the imaging device between at least an active mode and a ready mode;
in the active mode, maintaining a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate; and
in the ready mode, maintaining a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and
upon switching to the active mode from the ready mode, providing additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

### Claim 19 (depends on 18)

The method of claim 18, wherein the first criteria further include one or more of:
data estimating camera-to-eye distance,
data indicating multiple distinct tracked eye features,
camera data having a resolution reduced by a relatively low binning ratio,
data received from multiple cameras,
the imaging device being configured to use multiple light sources, or
a particular eye position and a particular eye orientation; and
wherein the second criteria further include one or more of:
data indicating a single distinct tracked eye feature,
camera data having a resolution reduced by a relatively high binning ratio,
data received from a single camera,
the imaging device being configured to use a single light source,
data measurements based on partially processed data, or
the particular eye position without the particular eye orientation.

### Claim 20 (depends on 18)

A computer program product embodied in a non-transitory computer readable medium, the computer program product comprising computer-executable instructions for executing the method of claim 18.

### Claim 21

A method in a personal computer system, the personal computer system comprising:
a visual display;
an imaging device adapted to provide data measurements by imaging at least one eye of a viewer of the visual display, wherein the data measurements describe one or more of eye position or eye orientation; and
an input device for accepting eye-tracking control data and other input data,
said method comprising the steps of:
switching the imaging device between at least an active mode and a ready mode;
in the active mode, maintaining a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate; and
in the ready mode, maintaining a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and
upon switching to the active mode from the ready mode, providing additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

### Claim 22 (depends on 21)

The method of claim 21, wherein the first criteria further include one or more of:
data estimating camera-to-eye distance,
data indicating multiple distinct tracked eye features,
camera data having a resolution reduced by a relatively low binning ratio,
data received from multiple cameras, or
the imaging device being configured to use multiple light sources, or
a particular eye position and a particular eye orientation.

### Claim 23 (depends on 21)

The method of claim 21, wherein the second criteria further include one or more of:
data indicating a single distinct tracked eye feature,
camera data having a resolution reduced by a relatively high binning ratio,
data received from a single camera,
the imaging device being configured to use a single light source, or
data measurements based on partially processed data, or
a particular eye position without a particular eye orientation.

### Claim 24 (depends on 21)

A computer program product embodied in a non-transitory computer readable medium, the computer program product comprising computer-executable instructions of executing the method of claim 21.
