# US 2023/0273678 A1 · Eye glint imaging in see-through computer display systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273678 A1
- Document ID: US20230273678A1
- Status: Published application
- Kind: A1
- Application number: 18/304,303
- Filed: 2023-04-20
- Published: 2023-08-31
- Earliest claimed: 2014-01-21
- Assignees: Mentor Acquisition One, LLC
- Applicants: Mentor Acquisition One, LLC
- Inventors: John N. BORDER
- Web page: https://patentgrep.com/patent/US20230273678A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G02B 5/045: {Prism arrays}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 27/0189: {Sight systems}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/03545: {Pens or stylus}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06V 30/1423: {the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32)}
- G06V 40/19: Sensors therefor
- G06V 40/193: {Preprocessing; Feature extraction}
- G09G 3/003: {to produce spatial visual effects}
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- G09G 5/10: Intensity circuits
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02C 7/086: {Auxiliary lenses located directly on a main spectacle lens or in the immediate vicinity of main spectacles}
- G02C 11/10: {Electronic devices other than hearing aids}
- G09G 5/028: {Circuits for converting colour display signals into monochrome display signals}
- G09G 2320/0242: Compensation of deficiencies in the appearance of colours
- G09G 2320/0626: for control of overall brightness
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)

## Abstract

Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

## Claims

### Claim 1

A wearable head device comprising:
a see-through display configured to present content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint;
one or more sensors; and
one or more processors configured to perform a method comprising:
capturing, via the one or more sensors, an image of the eye glint;
determining, based on the image of the eye glint, a level of sharpness associated with the content;
in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and
in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness.

### Claim 2 (depends on 1)

The wearable device of claim 1, wherein the method further comprises:
capturing, via the one or more sensors, an image of the iris of the eye; and
determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris.

### Claim 3 (depends on 2)

The wearable device of claim 2, wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

### Claim 4 (depends on 2)

The wearable device of claim 2, further comprising a wearable device optic configured to provide the content to the see-through display, wherein increasing the level of sharpness comprises adjusting a focus of the wearable device optic.

### Claim 5 (depends on 1)

The wearable device of claim 1, wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

### Claim 6 (depends on 5)

The wearable device of claim 5, wherein the method further comprises determining whether a gaze location of the user is associated with the first region,
wherein increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the first region.

### Claim 7 (depends on 5)

The wearable device of claim 5, wherein the method further comprises determining whether a gaze location of a user is associated with the second region,
wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the second region.

### Claim 8

A method comprising:
presenting, via a see-through display of a wearable head device, content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint;
capturing, via one or more sensors of the wearable head device, an image of the eye glint;
determining, based on the image of the eye glint, a level of sharpness associated with the content;
in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and
in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
capturing, via the one or more sensors, an image of the iris of the eye; and
determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris.

### Claim 10 (depends on 9)

The method of claim 9, wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

### Claim 11 (depends on 9)

The method of claim 9, wherein increasing the level of sharpness comprises adjusting a focus of a wearable device optic, the wearable device optic configured to provide the content to the see-through display.

### Claim 12 (depends on 8)

The method of claim 8, wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

### Claim 13 (depends on 12)

The method of claim 12, wherein the method further comprises determining whether a gaze location of the user is associated with the first region,
wherein increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the first region.

### Claim 14 (depends on 12)

The method of claim 12, wherein the method further comprises determining whether a gaze location of the user is associated with the second region,
wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the gaze location is associated with the second region.

### Claim 15

A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method, comprising:
presenting, via a see-through display of a wearable head device, content to an eye of a user of the wearable head device, such that presenting the content to the eye produces an eye glint;
capturing, via one or more sensors of the wearable head device, an image of the eye glint;
determining, based on the image of the eye glint, a level of sharpness associated with the content;
in accordance with a determination that the level of sharpness is below a threshold, increasing the level of sharpness; and
in accordance with a determination that the level of sharpness is not below the threshold, forgoing increasing the level of sharpness.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the method further comprises:
capturing, via the one or more sensors, an image of the iris of the eye; and
determining a gaze location of the user based on the image of the eye glint and further based on the image of the iris.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein increasing the level of sharpness is performed further in accordance with a determination of the gaze location relative to the see-through display.

### Claim 18 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein increasing the level of sharpness comprises adjusting a focus of a wearable device optic, the wearable device optic configured to provide the content to the see-through display.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the see-through display comprises a first region corresponding to a central region of the see-through display and a second region corresponding to a peripheral region of the see-through display.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the method further comprises determining whether a gaze location of the user is associated with the first region or the second region,
wherein increasing the level of sharpness is performed further in accordance with a determination that the view target is associated with the first region, and
wherein forgoing increasing the level of sharpness is performed further in accordance with a determination that the view target is associated with the second region.
