# US 11,908,129 B2 · Impairment analysis systems and related methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,908,129 B2
- Document ID: US11908129B2
- Status: Granted
- Kind: B2
- Application number: 17/132,319
- Filed: 2020-12-23
- Published: 2021-07-01
- Granted: 2024-02-20
- Earliest claimed: 2019-12-27
- Assignees: iAlyze, LLC
- Applicants: iAlyze, LLC
- Inventors: Willem Prins; Alexander Adam Papp; Matthew E. Czajkowski
- Web page: https://patentgrep.com/patent/US11908129B2

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G01P 13/00: Indicating or recording presence, absence, or direction, of movement (electric switches H01H; counting moving objects G06M7/00)
- G01S 15/08: Systems for measuring distance only (indirect measurement G01S15/46)
- G06F 18/24323: {Tree-organised classifiers}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 10/141: Control of illumination
- G06V 10/764: using classification, e.g. of video objects
- G06V 40/166: {using acquisition arrangements}
- G06V 40/19: Sensors therefor
- H04N 23/56: provided with illuminating means
- G01S 15/86: Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
- G01S 15/88: Sonar systems specially adapted for specific applications (seismic or acoustic prospecting or detecting G01V1/00)
- G06T 2207/10048: Infrared image
- G06T 2207/30201: Face
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Impairment analysis systems and related methods are disclosed. According to an aspect, an impairment analysis system includes a light source configured for directing light towards a subject. Further, the system includes a distance sensor configured for determining a location of the subject. The system also includes an image capture device configured for capturing one or more images of the subject. Further, the system includes a computing device configured to control the light source to emit light in a predetermined pattern to apply light stimulus to the subject. The computing device is also configured to receive, from the distance sensor, information regarding the determined location of the subject. Further, the computing device is configured to receive, from the image capture device, the captured one or more images of the subject including one of a facial movement and position of the subject while the light stimulus is applied to the subject.

## Claims

### Claim 1

An impairment analysis system comprising:
a handheld image capture device that captures a plurality of images of an eye of a subject illuminated by ambient light over a period of time;
a computing device comprising at least one processor and memory configured to:
control a light source to emit light in a predetermined pattern for guiding the subject's eyes during capture of the plurality of images of the eye over the period of time;
receive, from the image capture device, the captured plurality of images, wherein the images include pixels corresponding to a pupil, iris, background, or other features of the eye of the subject;
maintain a database of machine learning analysis of other subject's normal eye movement in response to an applied light stimulus;
classify pixels from the captured plurality of images as either pupil, iris, background, or other features of the eye of the subject based on the database of machine learning analysis;
track movement of the classified pixels in the plurality of images over the period of time;
analyze impairment of the subject based on the tracked movement as compared to the machine learning analysis in the database; and
present, to a user, a result of the impairment analysis.

### Claim 2 (depends on 1)

The impairment analysis system of claim 1, wherein the light source comprises a light emitting diode (LED) system that guides the subject's eyes.

### Claim 3 (depends on 2)

The impairment analysis system of claim 2, wherein the LED system comprises a plurality of LEDs that are separate from each other and extend substantially along a straight line.

### Claim 4 (depends on 2)

The impairment analysis system of claim 2, wherein the LED system comprises:
a support structure comprising a first portion and a second portion that are attached to each other and movable with respect to each other; and
a first set of LEDs and a second set of LEDs attached to each other and to the support structure.

### Claim 5 (depends on 2)

The impairment analysis system of claim 2, wherein the LED system comprises a plurality of LEDs, and
wherein the computing device is configured to control the LEDs to emit light in accordance with the predetermined pattern.

### Claim 6 (depends on 1)

The impairment analysis system of claim 1, wherein the light source is configured to generate light for guiding the subject's eyes.

### Claim 7 (depends on 1)

The impairment analysis system of claim 1, further comprising an ultrasonic sensor configured for determining a location of the subject,
wherein the computing device configured to receive, from the ultrasonic sensor, information regarding the determined location of the subject, and
wherein the computing device is configured to use the information regarding the determined location of the subject for verifying whether the subject is within a predetermined location for analyzing the impairment of the subject.

### Claim 8 (depends on 1)

The impairment analysis system of claim 1, further comprising a display configured to display the result of the impairment analysis.

### Claim 9 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to present to the user a guide for administering the impairment analysis of the subject.

### Claim 10 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is attachable to the light source, a distance sensor, and the image capture device.

### Claim 11 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to detect the subject's face based on the captured one or more images.

### Claim 12 (depends on 11)

The impairment analysis system of claim 11, wherein the computing device is configured to implement face localization and/or pose localization based on the captured one or more images.

### Claim 13 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to:
track one or both of the subject's eyes and irises; and
analyze impairment of the subject based on the tracking of one or both of the subject's eyes and irises.

### Claim 14

An impairment analysis method comprising:
using a handheld device for capturing a plurality of images of an eye of a subject;
controlling a light source to emit light in a predetermined pattern for guiding the subject's eyes during capture of the plurality of images of the illuminated eye over the period of time;
receiving, from the image capture device, the captured plurality of images, wherein the images include pixels corresponding to a pupil, iris, background, or other features of the eye of the subject;
maintaining a database of machine learning analysis of other subject's normal eye movement in response to an applied light stimulus;
classifying pixels from the captured plurality of images as either pupil, iris, background, or other features of the eye of the subject based on the database of machine learning analysis;
analyzing impairment of the subject based on the tracked movement as compared to the machine learning analysis in the database; and
presenting, to a user, a result of the impairment analysis.

### Claim 15 (depends on 14)

The method of claim 14, wherein the light source comprises a light emitting diode (LED) system that directs light.

### Claim 16 (depends on 15)

The method of claim 15, wherein the LED system comprises a plurality of LEDs that are separate from each other and extend substantially along a straight line.

### Claim 17 (depends on 15)

The method of claim 15, wherein the LED system comprises:
a support structure comprising a first portion and a second portion that are attached to each other and movable with respect to each other; and
a first set of LEDs and a second set of LEDs attached to each other and to the support structure.

### Claim 18 (depends on 15)

The method of claim 15, wherein the LED system comprises a plurality of LEDs, and
wherein the method comprises controlling the LEDs to emit light in accordance with the predetermined pattern.

### Claim 19 (depends on 14)

The method of claim 14, wherein the system further comprises an ultrasonic sensor configured for determining a location of the subject;
wherein the method further comprises:
receiving, from the ultrasonic sensor, information regarding the determined location of the subject; and
using the information regarding the determined location of the subject for verifying whether the subject is within a predetermined location for analyzing the impairment of the subject.

### Claim 20 (depends on 14)

The method of claim 14, comprising displaying the result of the impairment analysis.

### Claim 21 (depends on 14)

The method of claim 14, comprising presenting to the user a guide for administering the impairment analysis of the subject.

### Claim 22 (depends on 14)

The method of claim 14, comprising detecting the subject's face based on the captured one or more images.

### Claim 23 (depends on 22)

The method of claim 22, comprising implementing face localization and/or pose localization based on the captured one or more images.

### Claim 24 (depends on 14)

The method of claim 14, further comprising:
tracking one or more of the subject's eyes; and
analyzing impairment of the subject based on the tracking of the one or both of the subject's eyes and irises.

### Claim 25 (depends on 14)

The method of claim 14, further comprising:
tracking one or more of the subject's eye irises; and
analyzing impairment of the subject based on the tracking of one or both of the subject's eyes and irises.

### Claim 26 (depends on 1)

The impairment analysis system of claim 1, wherein the determined portion of the subject's eyes is an approximate center of an iris or a pupil of the subject.

### Claim 27 (depends on 14)

The method of claim 14, wherein the determined portion of the subject's eyes is an approximate center of an iris or a pupil of the subject.

### Claim 28 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to:
determine an estimated center of a plurality of the classified pixels; and
track movement of the estimated center in the plurality of images over the period of time; and
analyze impairment of the subject based on the tracked movement of the estimated center.

### Claim 29 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to classify the pixels based on a database of images of eyes.

### Claim 30 (depends on 1)

The impairment analysis system of claim 1, wherein the image capture device and the computing device are configured as a handheld device.

### Claim 31 (depends on 1)

The impairment analysis system of claim 1, wherein the computing device is configured to:
detect a face of the subject;
determine one or more points on the face of the subject;
use the determined one or more points to obtain a normalized frame of reference of the face of the subject; and
track movement of the classified pixels in the plurality of images based on the normalized frame of reference of the face of the subject.
