# US 2021/0082371 A1 · Techniques for eye fatigue mitigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082371 A1
- Document ID: US20210082371A1
- Status: Published application
- Kind: A1
- Application number: 16/569,320
- Filed: 2019-09-12
- Published: 2021-03-18
- Earliest claimed: 2019-09-12
- Assignees: Logitech Europe S.A.
- Applicants: Logitech Europe S.A.
- Inventors: Ludovico Novelli; Olivier Theytaz
- Web page: https://patentgrep.com/patent/US20210082371A1

## CPC

- G09G 5/10: Intensity circuits
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 40/19: Sensors therefor
- G08B 21/02: Alarms for ensuring the safety of persons
- G06T 2207/30201: Face
- G09G 2320/0626: for control of overall brightness
- G09G 2320/0653: Controlling or limiting the speed of brightness adjustment of the illumination source
- G09G 2320/066: for control of contrast
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

Eye fatigue from looking too long at a computer monitor can not only causes physical symptoms, it can also reduce productivity. Eye tracking is used to determine potential eye fatigue. After potential eye fatigue is determined, an eye fatigue mitigation action is triggered. Eye fatigue mitigation action can including providing a notification, blurring a screen, and blanking a screen. Eye tracking can also be used to verify that a user has taken an eye fatigue mitigation action, such as diverted looking from a screen for a sufficient amount of time. By implementing eye fatigue mitigation actions, symptoms can be reduced and/or productivity increased.

## Claims

### Claim 1

A system for mitigating eye fatigue for a user viewing a display comprises:
a camera having an image sensor;
a computing device having a display; and
one or more non-transitory memory devices containing instructions that, when executed by one or more processors, configure the one or more processors to:
capture, by the image sensor, a plurality of images of a user's eye;
monitor, based on the plurality of images, a gaze direction of the user's eye;
determine, whether the gaze direction of the user's eye is directed away from the display;
determine, based on the determination that the gaze direction of the user's eye is away from a specified region of the display, that the user is performing an eye fatigue mitigation action (EFMA) to mitigate an eye-fatigue condition of the user caused by looking at the display;
determine whether the user's eye fatigue has decreased, and in response to determining that the user's eye fatigue has not decreased:
alert the user to perform eye fatigue mitigation exercises based on the eye-fatigue condition of the user; and
track whether the user is performing the eye fatigue mitigation exercises, wherein the eye fatigue mitigation exercises including at least one of:
requesting that the user blink a predetermined number of times within a time period;
requesting that the user track a location of an icon on the display over the time period; or
requesting that the user look away from the display at a location a predetermined distance past a location of the display relative to the user;
determine whether the user's eye fatigue has decreased after tracking whether the user is performing the eye fatigue mitigation exercises; and
in response to determining that the user's eye fatigue has not decreased, adjust an output of the display that reduces user eye fatigue, wherein adjusting the output of the display includes adjusting parameters for at least one of:
display color;
display sharpness;
display backlight settings;
display hue;
display tint;
display aspect ratio;
display font sizes;
display brightness; or
display contrast.

### Claim 2

An apparatus for mitigating eye fatigue for a user viewing a display, the apparatus comprising:
a camera having an image sensor;
a display; and
one or more non-transitory memory devices containing instructions that, when executed by one or more processors, configure the one or more processors to:
capture, by the image sensor, a plurality of images of a user's eye;
monitor, based on the plurality of images, a gaze direction of the user's eye;
determine, whether the gaze direction of the user's eye is directed away from the display; and
determine, based on the determination that the gaze direction of the user's eye is away from the display, that the user is performing an eye fatigue mitigation action (EFMA) to mitigate an eye-fatigue condition of the user caused by looking at the display.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein determining whether the gaze direction of the user's eye is directed away from the display includes instructions that configure the one or more processors to:
calculate that the gaze direction of the user is away from the display for a length of time within a time period; and
determine that the length of time exceeds a threshold value within the time period.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein modifying the EFMA includes instructions that configure the one or more processors to:
determine whether the user's eye fatigue has decreased; and
in response to determining that the user's eye fatigue has not decreased, adjust an output of the display that reduces user eye fatigue.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein adjusting the output of the display includes adjusting parameters for at least one of:
display color;
display sharpness;
display backlight settings;
display hue;
display tint;
display aspect ratio;
display font sizes;
display brightness; or
display contrast.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein:
the instructions configure the one or more processors to detect an ambient lighting based on the plurality of images or a light sensor, and
the adjusting of the output of the display is based on the ambient lighting detected.

### Claim 7 (depends on 2)

The apparatus of claim 2, wherein the image sensor is configured to detect light in only the visible light spectrum.

### Claim 8

A method for mitigating eye fatigue for a user viewing a display, the method comprising:
capturing, by an image sensor, a plurality of images of a user's eye;
monitoring, based on the plurality of images, a gaze direction of the user's eye;
determining, whether the gaze direction of the user's eye is directed away from the display; and
determining, based on the determination that the gaze direction of the user's eye is away from the display, that the user is performing an eye fatigue mitigation action (EFMA) to mitigate an eye-fatigue condition of the user caused by looking at the the display.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
determining that the user's eye is no longer fatigued based on the user performing the eye fatigue mitigation action; and
modifying the EFMA based on determining the user's eye is no longer fatigued.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining that the user's eye is no longer fatigued includes determining focal length of eyes of the user were greater than a distance from the user to the display.

### Claim 11 (depends on 9)

The method of claim 9, wherein determining that the user's eye is no longer fatigued includes determining a color of a sclera of the user's eye has turned whiter.

### Claim 12 (depends on 9)

The method of claim 9, wherein determining that the user's eye is no longer fatigued includes determining that blink rate of the user has increased.

### Claim 13 (depends on 9)

The method of claim 9, wherein modifying the EFMA includes resetting a baseline for a fatigued state in response to determining that the user's eye is no longer fatigued.

### Claim 14 (depends on 9)

The method of claim 9, wherein modifying the EFMA includes adjusting an output of the display in response to determining that the user's eye is no longer fatigued.

### Claim 15 (depends on 14)

The method of claim 14, wherein adjusting the output of the display reverses an action triggered by a determination that the user's eye was fatigued.

### Claim 16 (depends on 8)

The method of claim 8, further comprising:
determining whether the user's eye fatigue has decreased; and
in response to determining that the user's eye fatigue has not decreased:
alerting the user to perform eye fatigue mitigation exercises based on the eye-fatigue condition of the user; and
tracking whether the user is performing the eye fatigue mitigation exercises.

### Claim 17 (depends on 16)

The method of claim 16, wherein the eye fatigue mitigation exercises including at least one of:
requesting that the user blink a predetermined number of times within a time period; or
requesting that the user look away from the display at a location a predetermined distance past a location of the display relative to the user.

### Claim 18 (depends on 17)

The method of claim 17, wherein the requesting that the user look away from the display further includes:
tracking a location and size of a user's pupil relative to the user's eye; and
determining whether the user looked away from the display in response to the request that the user look away from the display based on the tracked location and size of the user's pupil.

### Claim 19 (depends on 17)

The method of claim 17, further comprising:
determining whether the user's eye fatigue has decreased; and
in response to determining that the user's eye fatigue has not decreased or the user has not complied with the EFMA:
generating an alert for the user indicating that eye fatigue has not decreased; and
modifying the EFMA based on a most-recent detected eye fatigue condition of the user.

### Claim 20 (depends on 8)

The method of claim 8, wherein the image sensor is configured to detect light in only the visible light spectrum.
