# US 10,503,252 B2 · System and method for eye-reactive display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,503,252 B2
- Document ID: US10503252B2
- Status: Granted
- Kind: B2
- Application number: 16/404,506
- Filed: 2019-05-06
- Published: 2019-09-05
- Granted: 2019-12-10
- Earliest claimed: 2016-09-26
- Applicants: Ihab Ayoub
- Inventors: Ihab Ayoub
- Web page: https://patentgrep.com/patent/US10503252B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/147: using display panels
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 7/0012: {Biomedical image inspection}
- G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence)
- G06T 2207/30041: Eye; Retina; Ophthalmic
- G09G 2320/0626: for control of overall brightness
- G09G 2320/066: for control of contrast
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2320/08: Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
- G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it
- G09G 2340/0464: Positioning
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A computerized method, system for, and computer-readable medium operable to: detect an eye condition of a viewer of displayed content; assess the eye condition against predetermined criteria; identify a preferred behavior or display alteration selected to improve the eye condition; and alter the displayed content in a predetermined manner selected to induce the preferred behavior or compensate for an observed condition.

## Claims

### Claim 1

A system for altering displayed content based upon a condition of a viewer's eye, comprising:
a content data store configured to store computer-readable instructions relating to the displayed content;
a compensatory data store configured to store computer-readable instructions relating to the implementation of predetermined changes to the displayed content;
a processor for executing computer-readable instructions;
a sensor configured to sense indicators of at least one predetermined eye status of a viewer's eye;
an analyzer module operatively-connected to the sensor and configured to determine the existence and degree of the predetermined eye status based on data from the sensor;
an operatively-connected display device; and
a presentation module configured to provide altered and unaltered content to the display device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the eye status comprises at least one selected from dryness, blink rate, pupil size, movement, reactivity, orientation, accommodation, redness, discharge, and sclera color and the predetermined changes comprise at least one selected from resizing, brightness, contrast, and focal depth.

### Claim 3 (depends on 1)

The system of claim 1, further comprising an operatively-connected GPU, wherein the computer-readable instructions of the compensatory data store are configured to temporarily alter parameters of the GPU.

### Claim 4

A computer-implemented method comprising:
under control of one or more computing devices configured with specific computer-executable instructions,
receiving, during presentation of visual content, data regarding at least one eye of a user to whom the visual content is being presented;
determining whether the data regarding the at least one eye is relevant to a predetermined eye status;
in response to determining that the data regarding the at least one eye is relevant to the predetermined eye status, assessing whether the relevant eye status data meets a threshold;
upon assessing that the threshold is met by the relevant eye status data, selecting a compensator from an compensator data store; and
applying changes defined by the compensator to the visual content during the presentation of the visual content to the user.

### Claim 5 (depends on 4)

The method of claim 4, wherein the compensator is selected to correlate with the relevant eye status, such that the changes defined by the compensator will substantially compensate for at least one symptom of the relevant eye status in a manner that increases the perceived quality of the visual content.

### Claim 6 (depends on 4)

The method of claim 4, wherein multiple compensators are selected to compensate for the relevant eye status.

### Claim 7 (depends on 4)

The method of claim 4, further comprising establishing the threshold based upon a plurality of historical observations of the at least one eye of the user.

### Claim 8 (depends on 4)

The method of claim 4, wherein receiving data regarding the at least one eye comprises tracking, via at least one eye-tracking sensor, at least one selected from the orientation, and the location, of the at least one eye.

### Claim 9 (depends on 8)

The method of claim 8, further comprising adjusting for the orientation of the at least one eye prior to determining whether the condition meets the predetermined threshold.

### Claim 10 (depends on 4)

The method of claim 4 further comprising sampling, via at least one sensor, at least one environmental factor and evaluating the sampled factor to assess environmental impact upon the condition of the at least one eye, wherein the environmental factor is selected from humidity, location of illumination sources, ambient light, angle of display, relative angle of display to the eye, environmental pollutants, and temperature.

### Claim 11 (depends on 4)

The method of claim 4, further comprising evaluating a location proximal the at least one eye, via at least one sensor, at least one selected from brightness of displayed content, distance of the at least one eye from a display device, muscle tone, muscle tension, skin movement, and skin moisture.

### Claim 12 (depends on 4)

The method of claim 4, wherein the predetermined eye status comprises at least one selected from focus, pupil size, focal depth, and proximity.

### Claim 13 (depends on 4)

The method of claim 4, wherein the compensator-defined change to the displayed content comprises altering at least one selected from focus, size, location, brightness, contrast, transparency, permanence, font, and color.

### Claim 14 (depends on 4)

The method of claim 4, wherein the altering is performed by modifying at least one parameter of an operatively-connected GPU.

### Claim 15 (depends on 4)

The method of claim 4, wherein the changes to the visual content comprise enhancing at least one visible aspect of the visual content.

### Claim 16 (depends on 4)

The method of claim 4, further comprising repeating the receiving, determining, and assessing steps, as applicable, after applying changes defined by the compensator, and in response to an assessment that the threshold is no longer met, decreasing or discontinuing the changes applied to the visual content.

### Claim 17 (depends on 4)

The method of claim 4, wherein the degree of changes applied is variable based on an amount by which the threshold is exceeded.

### Claim 18 (depends on 4)

The method of claim 4, further comprising repeating the receiving, determining, and assessing steps, as applicable, after applying changes defined by the compensator, and in response to an assessment that the threshold is exceeded by a greater amount compared to a preceding assessment, performing at least one selected from increasing the degree of changes applied, and implementing at least one an additional compensator.

### Claim 19

A non-transitory computer storage medium which stores a computer-executable module, the module, when executed by one or more processors, being configured to:
receive, during presentation of visual content, data regarding at least one eye of a user to whom the visual content is being presented;
determine whether the data regarding the at least one is relevant to a predetermined eye status;
in response to determining that the data regarding the at least one eye is relevant to the predetermined eye status, assess whether the relevant eye status data meets a threshold;
upon assessing that the threshold is met by the relevant eye status data, select a compensator from an compensator data store, the compensator correlating to the predetermined eye status; and
apply changes defined by the compensator to the visual content during the presentation of the visual content to the user.

### Claim 20 (depends on 19)

The non-transitory computer storage medium of claim 19, wherein the application of the changes defined by the compensator continues until an automated and substantially continuous repetition of the determining and the assessing indicates that the threshold is no longer met.
