# US 2025/0366718 A1 · System and method for eye tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0366718 A1
- Document ID: US20250366718A1
- Status: Published application
- Kind: A1
- Application number: 19/296,981
- Filed: 2025-08-12
- Published: 2025-12-04
- Earliest claimed: 2019-01-03
- Assignees: Immersix Ltd.
- Applicants: Immersix Ltd
- Inventors: ORI WEITZ; SAAR WILF
- Web page: https://patentgrep.com/patent/US20250366718A1

## CPC

- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 3/0008: {provided with illuminating means (A61B3/117, A61B3/14 take precedence)}
- A61B 3/0025: {characterised by electronic signal processing, e.g. eye models}
- A61B 3/113: for determining or recording eye movement
- A61B 3/12: for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence)
- A61B 3/14: Arrangements specially adapted for eye photography
- A61B 5/0062: {Arrangements for scanning}
- A61B 5/1071: {measuring angles, e.g. using goniometers (A61B5/1123 takes precedence)}
- A61B 5/1079: {using optical or photographic means}
- A61B 5/1171: based on the shapes or appearances of their bodies or parts thereof
- A61B 5/7246: {using correlation, e.g. template matching or determination of similarity}
- A61B 5/7267: {involving training the classification device}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/248: {involving reference images or patches}
- G06T 7/50: Depth or shape recovery
- G06T 7/74: {involving reference images or patches}
- G06V 10/141: Control of illumination
- G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 40/18: Eye characteristics, e.g. of the iris
- G06V 40/197: {Matching; Classification}
- H04N 23/56: provided with illuminating means
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- A61B 5/6821: {Eye}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 2207/10048: Infrared image
- G06T 2207/20081: Training; Learning
- G06T 2207/30041: Eye; Retina; Ophthalmic
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system and method for inputting to a statistical model a reference image, which is associated with a known direction of gaze of a person and which includes at least a portion of the person's retina, and an input image which is associated with an unknown direction of gaze of the person and which includes at least a portion of the person's retina. The statistical model is trained on multiple images of portions of retinas obtained at known directions of gaze and can output an estimation of a change in orientation of an eye of the person. A signal generated based on the estimation can be used to control a device.

## Claims

### Claim 1

A method for user identity authentication, the method comprising:
i. obtaining at least one identification image of a person's retina, the identification image comprising at least a portion of the person's retina associated with a known direction of gaze;
ii. finding a spatial transformation between a reference image and an identification image, the reference image comprising at least a portion of a retina linked to a known direction of gaze and to a known person;
iii. calculating a direction of gaze associated with the identification image, based on the transformation and the known direction of gaze linked to the reference image; and
iv. identifying the person as the known person based on a match between the calculated direction of gaze associated with the identification image and the known direction of gaze associated with the identification image.

### Claim 2 (depends on 1)

The method of claim 1 comprising:
repeating steps ii and iii; and
identifying the person as the known person based on a plurality of matches between the calculated direction of gaze associated with the identification image and the known direction of gaze associated with the identification image.

### Claim 3 (depends on 1)

The method of claim 1 wherein the identification image which is transformed according to the spatial transformation is a transformed identification image, the method comprising:
finding a correlation between at least one transformed identification image and at least one reference image; and
identifying the person as the known person, based on at least one correlation and based on at least one match between the calculated direction of gaze associated with the identification image and the known direction of gaze associated with the identification image.

### Claim 4 (depends on 3)

The method of claim 3 wherein finding a correlation between the transformed identification image and the reference image comprises using a Pearson's correlation coefficient.

### Claim 5 (depends on 1)

The method of claim 1 wherein calculating the direction of gaze associated with the identification image comprises:
finding a spatial transformation between the identification image and the reference image;
converting the spatial transformation to a corresponding spherical rotation;
using the spherical rotation to rotate the known direction of gaze linked to the reference image to calculate a change in orientation of an eye of the person; and
determine the direction of gaze based on the change in orientation of the eye.

### Claim 6 (depends on 5)

The method of claim 5 wherein the reference image is linked to one or more of: a known orientation of an eye, a known gaze target and a known ray of gaze, the method further comprising the step of determining, based on the reference image and the change in orientation of the eye of the person, one or more of: an orientation of the person's eye associated with the identification image, a direction of gaze associated with the identification image, a gaze target associated with the identification image and a ray of gaze associated with the identification image.

### Claim 7 (depends on 1)

The method of claim 1 wherein calculating a direction of gaze associated with the identification image comprises using a statistical model trained on multiple pairs of a reference image and an identification image and spatial transformations between the multiple pairs.

### Claim 8 (depends on 1)

The method of claim 1 wherein finding a spatial transformation between the identification image and the reference image comprises:
performing multiple spatial transformations between the identification image and reference image;
finding a similarity measure between the identification image and reference image corresponding to each spatial transformation; and
choosing a spatial transformation based on the similarity measure.

### Claim 9 (depends on 1)

The method of claim 1 comprising:
performing multiple spatial transformations between the identification image and reference image;
determining multiple directions of gaze associated with the identification image based on each transformation; and
calculating the direction of gaze associated with the identification image based on a statistic of the multiple directions of gaze.

### Claim 10 (depends on 1)

The method of claim 1 wherein the identification image and the reference image are planar images, the method comprising:
projecting at least one planar identification image to a sphere to obtain at least one spherical identification image;
projecting at least one planar reference image to a sphere to obtain at least one spherical reference image; and
finding a spherical rotation between the spherical reference image and the spherical identification image.

### Claim 11 (depends on 1)

The method of claim 1 comprising:
finding a planar rigid transformation between a planar identification image and a planar reference image; and
converting the planar rigid transformation to a corresponding spherical rotation.

### Claim 12 (depends on 1)

The method of claim 1 wherein the reference image is linked to a known or theoretical pixel of the fovea.

### Claim 13 (depends on 1)

The method of claim 1 comprising:
calculating a location of the person's fovea in the identification image based on the spatial transformation, to obtain a calculated location of fovea; and
calculating one or more of: orientation of the eye of the person, the direction of gaze, the gaze target and the ray of gaze, associated with the identification image, based on the calculated location of fovea.

### Claim 14 (depends on 1)

The method of claim 1 comprising processing the identification image and reference image to normalize intensity of the identification image and reference image, prior to finding the spatial transformation.

### Claim 15 (depends on 1)

The method of claim 1 wherein the identification image is obtained by a same camera or a camera providing same optical results as a camera used to obtain the reference image.

### Claim 16

A system for user identity authentication, the system comprising:
at least one camera to capture an identification image of a person's eye, the identification image comprising at least a portion of the person's retina associated with a known direction of gaze;
a user's identity database comprising reference images of a known person, each reference image comprising at least a portion of the known person's retina linked to a known direction of gaze; and
a processor in communication with the camera and the user's identity database, the processor to
receive at least one identification image,
transform the identification image relative to a reference image from the user's identity database,
determine a direction of gaze associated with the identification image based on the transformation and the known direction of gaze linked to the reference image, and
identify the person as the known person based on at least one match between the determined direction of gaze associated with the identification image and the known direction of gaze associated with the identification image.

### Claim 17 (depends on 16)

The system of claim 16 wherein the processor compares the transformed identification image to the reference image to obtain a correlation; and identifies the person as the known person, based on at least one correlation and based on the at least one match between the determined direction of gaze associated with the identification image and the known direction of gaze associated with the identification image.

### Claim 18 (depends on 16)

The system of claim 16 comprising a statistical model trained on multiple pairs of a reference image and an identification image and spatial transformations between the multiple pairs, wherein the processor transforms the identification image relative to the reference image from the user's identity database based on output from the statistical model.
