# US 10,481,681 B2 · Current drain reduction in AR/VR display systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,481,681 B2
- Document ID: US10481681B2
- Status: Granted
- Kind: B2
- Application number: 15/448,402
- Filed: 2017-03-02
- Published: 2017-09-07
- Granted: 2019-11-19
- Earliest claimed: 2016-03-04
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Tal Mor
- Web page: https://patentgrep.com/patent/US10481681B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 1/3231: Monitoring the presence, absence or movement of users
- G06F 1/3265: {Power saving in display device}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G09G 3/3406: {Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336)}
- G09G 3/3648: {using an active matrix (G09G3/367 - G09G3/3696 take precedence)}
- G09G 2330/021: Power management, e.g. power saving
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G09G 2354/00: Aspects of interface with display user
- Y02D 10/153
- Y02D 10/173
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

In some embodiments, eye tracking is used on an AR or VR display system to determine if a user of the display system is blinking or otherwise cannot see. In response, current drain or power usage of a display associated with the display system may be reduced, for example, by dimming or turning off a light source associated with the display, or by configuring a graphics driver to skip a designated number of frames or reduce a refresh rate for a designated period of time.

## Claims

### Claim 1

A display system with reduced power use, comprising:
an inward-facing sensor;
a display comprising a light source; and
processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:
detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reduce a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises dimming the light source of the display without turning off the light source, and
increase a current drain of the display system in response to the detected second change in the user's eye status,
wherein the first and second changes in the user's eye status is a blink.

### Claim 2

A method for reducing power use of a display system, comprising:
detecting a first change in a user's eye status using an inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises dimming a light source of the display without turning off the light source, and
increasing a current drain of the display system in response to detecting the second change in the user's eye status,
wherein the first and second changes in the user's eye status is a blink.

### Claim 3

A display system with reduced power use, the display system comprising:
an inward-facing sensor;
a head-mounted display configured to be worn by a user and disposed on a frame configured to support said display thereon, said display configured to project light into said user's eye to display augmented reality image content to the user's vision field, at least a portion of said display being transparent and disposed at a location in front of the user's eye when the user wears the frame such that said transparent portion transmits light from a portion of an environment in front of the user and said head-mounted display to the user's eye to provide a view of said portion of the environment in front of the user and said head-mounted display; and
processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:
detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes, and
reduce a current drain of the display system in response to the change in the user's eye status, wherein reducing the current drain of the display comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display without turning off the display.

### Claim 4 (depends on 3)

The display system of claim 3, wherein the display comprises a light source, and wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 5 (depends on 3)

The display system of claim 3, wherein the graphics driver is further configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

### Claim 6 (depends on 3)

The display system of claim 3, wherein the processing electronics is configured to reduce the current drain of the display by reducing a refresh rate associated with the display.

### Claim 7

A method for reducing power use of a display system, comprising:
detecting a first change in a user's eye status using an inward facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises configuring a graphics driver associated with a display to reduce an amount of power consumed by the display without turning off the display, and
increasing a current drain of the display system in response to detecting the second change in the user's eye status.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first and second changes in the user's eye status corresponds to a blink.

### Claim 9 (depends on 7)

The method of claim 7, wherein reducing the current drain of the display further comprises turning off the light source.

### Claim 10 (depends on 7)

The method of claim 7, wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 11 (depends on 7)

The method of claim 7, wherein the graphics driver is configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

### Claim 12 (depends on 7)

The method of claim 7, wherein the processing electronics is configured to further reduce the current drain of the display by reducing a refresh rate associated with the display.

### Claim 13

A method for reducing power use of a display system, comprising:
detecting a first change in a user's eye status using an inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises skipping a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see, and
increasing a current drain of the display system in response to detecting the second change in the user's eye status.

### Claim 14 (depends on 13)

The method of claim 13, wherein the first and second changes in the user's eye status corresponds to a blink.

### Claim 15 (depends on 13)

The method of claim 13, wherein reducing the current drain of the display further comprises turning off the light source.

### Claim 16 (depends on 13)

The method of claim 13, wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 17 (depends on 13)

The method of claim 13, wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

### Claim 18 (depends on 13)

The method of claim 13, wherein the processing electronics is further configured to reduce the current drain of the display by reducing a refresh rate associated with the display.

### Claim 19

A display system with reduced power use, comprising:
an inward-facing sensor;
a display; and
processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:
detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reduce a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises skipping a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see, and
increase a current drain of the display system in response to the detected second change in the user's eye.

### Claim 20 (depends on 19)

The display system of claim 19, wherein the first and second changes in the user's eye status corresponds to a blink.

### Claim 21 (depends on 19)

The display system of claim 19, wherein reducing the current drain of the display further comprises turning off the light source.

### Claim 22 (depends on 19)

The display system of claim 19, wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 23 (depends on 19)

The display system of claim 19, wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

### Claim 24 (depends on 19)

The display system of claim 19, wherein the processing electronics is further configured to reduce the current drain of the display by reducing a refresh rate associated with the display.

### Claim 25

A method for reducing power use of a display system, comprising:
detecting a first change in a user's eye status using an inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises reducing a refresh rate associated with the display without turning off the display, and
increasing a current drain of the display system in response to detecting the second change in the user's eye status.

### Claim 26 (depends on 25)

The method of claim 25, wherein the first and second changes in the user's eye status corresponds to a blink.

### Claim 27 (depends on 25)

The method of claim 25, wherein reducing the current drain of the display further comprises turning off the light source.

### Claim 28 (depends on 25)

The method of claim 25, wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 29 (depends on 25)

The method of claim 25, wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

### Claim 30 (depends on 29)

The method of claim 29, wherein the graphics driver is further configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

### Claim 31

A display system with reduced power use, comprising:
an inward-facing sensor;
a display; and
processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:
detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,
detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,
reduce a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises reducing a refresh rate associated with the display without turning off the display, and
increase a current drain of the display system in response to the detected second change in the user's eye status.

### Claim 32 (depends on 31)

The display system of claim 31, wherein the first and second changes in the user's eye status corresponds to a blink.

### Claim 33 (depends on 31)

The display system of claim 31, wherein reducing the current drain of the display further comprises turning off the light source.

### Claim 34 (depends on 31)

The display system of claim 31, wherein reducing the current drain of the display further comprises dimming the light source of the display.

### Claim 35 (depends on 31)

The display system of claim 31, wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

### Claim 36 (depends on 35)

The display system of claim 35, wherein the graphics driver is further configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.
