# US 2022/0011858 A1 · Peripheral luminance or color remapping for power saving

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0011858 A1
- Document ID: US20220011858A1
- Status: Published application
- Kind: A1
- Application number: 17/316,460
- Filed: 2021-05-10
- Published: 2022-01-13
- Earliest claimed: 2020-07-09
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Yang Li; Alexandre Chapiro; Mehmet N. Agaoglu; Nicolas Pierre Marie Frederic Bonnier; Yi-Pai Huang; Chaohao Wang; Andrew B. Watson; Pretesh A. Mascarenhas
- Web page: https://patentgrep.com/patent/US20220011858A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)}
- G09G 5/10: Intensity circuits
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2320/0613: The adjustment depending on the type of the information to be displayed
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2320/0686: with two or more screen areas displaying information with different brightness or colours
- G09G 2330/021: Power management, e.g. power saving
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.

## Claims

### Claim 1

An electronic device, comprising:
a display comprising one or more foveated areas, a first area having a first luminance and a second area having a second luminance;
an eye tracker configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display; and
processing circuitry operatively coupled to the display and configured to:
receive an indication of a motion associated with the gaze from the eye tracker;
determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame; and
expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the display comprises a plurality of pixels, wherein each of the first area and the second area is rendered by a subset of the plurality of pixels.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the processing circuitry is configured to receive a direction of the gaze of the user from the eye tracker.

### Claim 4 (depends on 3)

The electronic device of claim 3, wherein the processing circuitry is configured to expand the one or more foveated areas in the same direction based at least in part on the gaze of the user.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the processing circuitry is configured to adjust a parameter of the one or more foveated areas based at least in part on frequency information of image content to be rendered on the display.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein a rate at which the one or more foveated areas expand is based at least in part on a speed of the gaze of the user, a location of the gaze of the user on the display, a type of content being displayed, a size of the display, or a size of the one or more foveated areas, or any combination thereof.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the processing circuitry is configured to:
receive a second indication of an error associated with the gaze from the eye tracker; and
in response to the second indication of the error, expand one or more foveated areas of the display adjacent a last known position of the gaze of the user.

### Claim 8

A non-transitory, computer-readable medium storing instructions that, when executed by a processor, cause the processor to:
identify a set of frequency information based at least in part on image content rendered on a display during an update of the image content;
in response to the identification of the set of frequency information:
adjust a first luminance level of a foveated area of the display based at least in part on the set of frequency information; and
adjust a second luminance level of a peripheral area of the display based at least in part on the set of frequency information, wherein the second luminance level is dimmer than the first luminance level.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the foveated area is positioned within the peripheral area, and wherein a luminance of the peripheral area tapers from a higher luminance near the foveated area to a lower luminance at a periphery of the peripheral area.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the set of frequency information is associated with a spatial frequency of the image content.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions cause the processor to adjust a color of the peripheral area of the display based at least in part on the set of frequency information.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the instructions cause the processor to shift the color of the peripheral area towards green.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions cause the processor to:
in response to the identification of the set of frequency information:
adjust a third luminance level of a second foveated area of the display based at least in part on the set of frequency information, wherein the second foveated area is positioned within the foveated area.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions cause the processor to:
identify a second set of frequency information based at least in part on a second image content rendered on the display, wherein the second set of frequency information is associated with a lower spatial frequency than the set of frequency information; and
in response to the identification of the second set of frequency information, raise the second luminance level of the peripheral area of the display.

### Claim 15

A method comprising:
receiving an input regarding a gaze of a user on a display;
receiving an indication of a location of the gaze from an eye tracker; and
in response to receiving the indication of the location:
adjusting a first luminance level of a foveated area of the display about the location of the gaze; or
adjusting a second luminance level of a peripheral area of the display; or
adjusting a color of the peripheral area of the display; or
any combination thereof.

### Claim 16 (depends on 15)

The method of claim 15, wherein the first luminance level differs from the second luminance level.

### Claim 17 (depends on 15)

The method of claim 15, wherein adjusting a color includes shifting the color of the peripheral area towards green.

### Claim 18 (depends on 15)

The method of claim 15, comprising adjusting a color of a second foveated area of the display, wherein the foveated area is positioned within the second foveated area.

### Claim 19 (depends on 15)

The method of claim 15, wherein the foveated area is positioned within the peripheral area, and wherein the color of the peripheral area tapers from a lower green level near the foveated area to a higher green level at a periphery of the peripheral area.

### Claim 20 (depends on 15)

The method of claim 15, wherein a center of the display is within the foveated area.
