# US 12,108,989 B2 · Eye imaging in head worn computing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,108,989 B2
- Document ID: US12108989B2
- Status: Granted
- Kind: B2
- Application number: 18/344,740
- Filed: 2023-06-29
- Published: 2023-10-26
- Granted: 2024-10-08
- Earliest claimed: 2014-01-21
- Assignees: Mentor Acquisition One, LLC
- Applicants: Mentor Acquisition One, LLC
- Inventors: John N. Border; John Haddick; Joseph Bietry
- Web page: https://patentgrep.com/patent/US12108989B2

## CPC

- A61B 3/14: Arrangements specially adapted for eye photography
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- A61B 3/0008: {provided with illuminating means (A61B3/117, A61B3/14 take precedence)}
- A61B 3/0025: {characterised by electronic signal processing, e.g. eye models}
- A61B 3/0041: {characterised by display arrangements}
- A61B 3/113: for determining or recording eye movement
- A61B 3/12: for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence)
- A61B 5/117: Identification of persons (methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00)
- A61B 5/1171: based on the shapes or appearances of their bodies or parts thereof
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G02C 11/10: {Electronic devices other than hearing aids}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/03542: {Light pens for emitting or receiving light}
- G06F 3/03545: {Pens or stylus}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 21/10: Protecting distributed programs or content, e.g. vending or licensing of copyrighted material (protection in video systems or pay television H04N7/16) {; Digital rights management [DRM]}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06F 21/88: Detecting or preventing theft or loss
- G06V 40/19: Sensors therefor
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/197: {Matching; Classification}
- H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)}
- H04L 63/102: {Entity profiles}
- H04W 12/06: Authentication
- H04W 12/33: using wearable devices, e.g. using a smartwatch or smart-glasses
- G02B 27/14: operating by reflection only
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B 2027/0198: {System for aligning or maintaining alignment of an image in a predetermined direction}
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Head-worn computers with eye-imaging systems include a camera system positioned in a head-worn computer, wherein the camera system is further positioned to capture eye-image light that originates as reflections from a user's eye, wherein the camera system is further positioned to capture eye-image light as a reflection from a partially reflective surface that is positioned in front of an image display in the head-worn computer, wherein image light, from the image display, is transmitted through the partially reflective surface. A processor is adapted to cause the camera system to capture the eye-image light. The processor is further adapted to cause a comparison of the captured eye-image light with a pre-stored eye image of a known user of the head-worn computer. In the event the comparison confirms the identity of the known user, the user is granted permission to view content to be presented in a display of the head-worn computer.

## Claims

### Claim 1

A system comprising:
a wearable head device comprising:
a camera;
a display;
a source of image light;
one or more sensors; and
a partially reflective surface positioned to receive image light from the source of image light; and
one or more processors configured to perform a method comprising:
determining an operation mode based on a signal received by the one or more sensors;
causing the source of image light to present image light, via the source of image light and further via the partially reflective surface, toward an eye of a user of the wearable head device;
in accordance with a determination that the operation mode comprises a first operation mode, capturing, via the camera at a first rate, eye-image light comprising a reflection of the presented light;
in accordance with a determination that the operation mode comprises a second operation mode, capturing, via the camera at a second rate different from the first rate, eye-image light comprising a reflection of the presented light; and
monitoring a health of the user based on the eye-image light.

### Claim 2 (depends on 1)

The system of claim 1, wherein monitoring the health of the user comprises detecting a health event.

### Claim 3 (depends on 2)

The system of claim 2, wherein the health event comprises one or more of a concussion, a brain injury, a stroke, and blood loss.

### Claim 4 (depends on 1)

The system of claim 1, wherein:
said presenting the image light toward the eye of the user comprises presenting the image light via a first optical path; and
the reflection of the presented light comprises a reflection of the light toward the camera along a second optical path at least partially collinear with the first optical path.

### Claim 5 (depends on 1)

The system of claim 1, wherein:
said presenting the image light toward the eye of the user comprises presenting the image light via a first optical path; and
the reflection of the presented light comprises a reflection of the light toward the camera along a second optical path not collinear with the first optical path.

### Claim 6 (depends on 1)

The system of claim 1, wherein the method further comprises:
determining that the wearable head device has been removed from the user; and
in response to the determination, forgoing causing the source of image light to present the image light.

### Claim 7 (depends on 1)

The system of claim 1, wherein said presenting the image light comprises presenting light outside of the visible spectrum.

### Claim 8 (depends on 1)

The system of claim 1, wherein determining the operation mode is further based on a health characteristic of the user, wherein the health characteristic comprises one or more of a heart rate, a blink rate, a blood glucose level, a hemoglobin level, and a presence of a first substance in the user's blood.

### Claim 9

A method comprising:
determining an operation mode based on a signal received by one or more sensors of the wearable head device, the wearable head device comprising a camera, a display, and a source of image light;
receiving image light, via the source of image light, at a partially reflective surface of the wearable head device;
presenting, via the partially reflective surface, the image light to an eye of a user of the wearable head device;
in accordance with a determination that the operation mode comprises a first operation mode, capturing, via the camera at a first rate, eye-image light comprising a reflection of the presented light;
in accordance with a determination that the operation mode corresponds to a second operation mode, capturing, via the camera at a second rate different from the first rate, eye-image light comprising a reflection of the presented light; and
monitoring a health of the user based on the eye-image light.

### Claim 10 (depends on 9)

The method of claim 9, wherein monitoring the health of the user comprises detecting a health event.

### Claim 11 (depends on 10)

The method of claim 10, wherein the health event comprises one or more of a concussion, a brain injury, a stroke, and blood loss.

### Claim 12 (depends on 9)

The method of claim 9, wherein:
said presenting the image light toward the eye of the user comprises presenting the image light via a first optical path; and
the reflection of the presented light comprises a reflection of the light toward the camera along a second optical path at least partially collinear with the first optical path.

### Claim 13 (depends on 9)

The method of claim 9, wherein:
said presenting the image light toward the eye of the user comprises presenting the image light via a first optical path; and
the reflection of the presented light comprises a reflection of the light toward the camera along a second optical path not collinear with the first optical path.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
determining that the wearable head device has been removed from the user; and
in response to the determination, forgoing receiving the image light at the partially reflective surface.

### Claim 15 (depends on 9)

The method of claim 9, wherein said presenting image light comprises presenting light outside of the visible spectrum.

### Claim 16 (depends on 9)

The method of claim 9, wherein determining the operation mode is further based on a health characteristic of the user, wherein the health characteristic comprises one or more of a heart rate, a blink rate, a blood glucose level, a hemoglobin level, and a presence of a first substance in the user's blood.

### Claim 17

A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
determining an operation mode based on a signal received by one or more sensors of the wearable head device, the wearable head device comprising a camera, a display, and a source of image light;
receiving image light, via the source of image light, at a partially reflective surface of the wearable head device;
presenting, via the partially reflective surface, the image light to an eye of a user of the wearable head device;
in accordance with a determination that the operation mode comprises a first operation mode, capturing, via the camera at a first rate, eye-image light comprising a reflection of the presented light;
in accordance with a determination that the operation mode corresponds to a second operation mode, capturing, via the camera at a second rate different from the first rate, eye-image light comprising a reflection of the presented light; and
monitoring a health of the user based on the eye-image light.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein monitoring the health of the user comprises detecting a health event.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the health event comprises one or more of a concussion, a brain injury, a stroke, and blood loss.

### Claim 20 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein determining the operation mode is further based on a health characteristic of the user, wherein the health characteristic comprises one or more of a heart rate, a blink rate, a blood glucose level, a hemoglobin level, and a presence of a first substance in the user's blood.