US 12,118,139 B2Granted

Optical system providing accurate eye-tracking and related method

AssigneeGanzin Technology, Inc.

InventorsKuan-Ling Liu, Po-Jung Chiu, Yi-Heng Wu, Kuei-An Li, Shao-Yi Chien

Life of this patent

Estimating the term…

Loading patent…

Abstract

During an eye-tracking operation of an optical system, one or multiple eye images are captured. One or multiple gaze points of the user are computed based on the one or multiple eye images of the user. A user interface containing one or multiple UI elements is provided based on the one or multiple gaze points of the user. A performance map of the eye-tracking operation is provided based on the one or multiple eye images of the user. At least one UI element is adjusted based on the performance map of the eye-tracking operation.

Claims23

Dependent claims

An optical system which improves user experience and accuracy of gaze-based interaction, comprising:

an eye-tracker, comprising:
a first sensor module configured to capture one or multiple eye images of a user;
and
a first processor configured to:
receive the one or more eye images captured by the first sensor module;
and
sample a position of the user's eye by computing one or more gaze points of the user based on the one or more eye images;
a head-mounted display, comprising:
a second processor configured to:
provide a user interface which contains one or multiple UI elements based on one or multiple gaze points of the user which are computed based on the one or multiple eye images;
construct a performance map of the eye-tracker according to a confidence and a sample rate of the eye-tracker acquired based on the one or multiple eye images of the user for representing performance of the eye-tracker relative to an initial field of view of the user when the user looks straight ahead, wherein:
the sample rate refers to how many times per unit time the eye-tracker samples the position of the user's eyes;
the performance map of the eye-tracker includes a plurality of default values respectively corresponding to a plurality of locations within the initial field of view of the user;
each default value of the performance map is adjusted before an operation of the eye-tracer based on a personal factor of the user or based on a distance between the user's eye and the first sensor module;
and
each default value of the performance map is updated during an operation of the eye-tracer;
evaluate a performance level of the eye tracker at a location of at least one UI element among the one or multiple UI elements of the user interface based on the performance map;
and
adjust the at least one UI element based on a result of evaluating the performance level of the eye-tracker;
and
a display configured to present the user interface.

18 more elements

A method of improving user experience and accuracy of gaze-based interaction, comprising:

capturing one or multiple eye images of a user during an eye-tracking operation;
sampling a position of the user's eye by computing one or multiple gaze points of the user based on the one or multiple eye images of the user;
providing a user interface containing one or multiple UI elements based on the one or multiple gaze points of the user;
constructing a performance map of the eye-tracking operation according to a confidence and a sample rate of the eye-tracking operation acquired based on the one or multiple eye images of the user for representing performance of the eye-tracking operation relative to an initial field of view of the user when the user looks straight ahead, wherein:
the sample rate refers to how many times per unit time the position of the user's eye is sampled during the eye-tracking operation;
the performance map of the eye-tracking operation includes a plurality of default values respectively corresponding to a plurality of locations within the initial field of view of the user;
each default value of the performance map is adjusted before the eye-tracking operation based on a personal factor of the user or based on a distance between the user's eye and the first sensor module;
and
each default value of the performance map is updated during the eye-tracking operation;
evaluating a performance level of the eye-tracking operation at a location of at least one UI element among the one or multiple UI elements of the user interface based on the performance map;
and
adjusting at least one UI element-based on a result of evaluating the performance level of the eye-tracking operation.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/849,726Filed 27 Jun 2022 · us provisional application
Priority: 28 Jun 2021
Published: US 2022/0413605 A129 Dec 2022
Granted: 15 Oct 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification17 codes

G06F 3/013
Arrangements for interaction with the human body, e.g. for user immersion in virtual reality: eye tracking input arrangements
G02B 27/0025
Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00: for optical correction, e.g. distorsion,…
G02B 27/0093
Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00: with means for monitoring data relating to the…
G02B 27/0101
Head-up displays: characterised by optical features

Family

Application63/215,984Us provisional application · filed 28 Jun 2021
US 2022/0413605 A1Pre-grant publication · published 29 Dec 2022
US 12,118,139 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key