# US 2019/0172382 A1 · Ambient light context-aware display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172382 A1
- Document ID: US20190172382A1
- Status: Published application
- Kind: A1
- Application number: 16/272,953
- Filed: 2019-02-11
- Published: 2019-06-06
- Earliest claimed: 2013-09-10
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Cynthia Sue Bell; Kevin Woo; Philip L. Barnes; Steven C. Glenner
- Web page: https://patentgrep.com/patent/US20190172382A1

## CPC

- G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)}
- G09G 3/007: {Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels}
- G09G 3/2096: {Details of the interface to the display terminal specific for a flat panel (suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167)}
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G09G 2320/0242: Compensation of deficiencies in the appearance of colours
- G09G 2320/0606: Manual adjustment
- G09G 2320/0626: for control of overall brightness
- G09G 2320/0653: Controlling or limiting the speed of brightness adjustment of the illumination source
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2320/0673: for control of gamma adjustment, e.g. selecting another gamma curve
- G09G 2340/06: Colour space transformation
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments are disclosed that relate to modifying a display of a portable electronic device to account for ambient light. For example, one disclosed embodiment provides a method comprising determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by an ambient light sensor, reading a display-ready image having a plurality of pixels from an image source, adjusting a manner in which the display-ready image is displayed by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, and displaying the color-modified image on the display of the portable electronic device.

## Claims

### Claim 1

A method for adjusting a display to account for ambient light, comprising:
at a portable electronic device:
determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by a light sensor;
reading a display-ready image from an image source, the display-ready image having a plurality of pixels;
adjusting a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image; and
displaying the color-modified image on the display of the portable electronic device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the light sensor is an ambient light sensor configured to detect a luminance and a correlated color temperature of ambient light.

### Claim 3 (depends on 1)

The method of claim 1, wherein the light sensor is a camera.

### Claim 4 (depends on 3)

The method of claim 3,
wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to capture ambient light; and
wherein determining an ambient light history includes determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by both the front and the rear camera.

### Claim 5 (depends on 1)

The method of claim 1,
wherein the plurality of ambient color conditions includes a white point; and
wherein adjusting a manner in which the display-ready image is displayed includes adjusting the white point of at least the subset of the plurality of pixels.

### Claim 6 (depends on 1)

The method of claim 1, wherein the ambient light history further includes luminance data, the method further comprising:
detecting a threshold brightness increase during a predetermined time period based on the luminance data in the ambient light history; and
applying a brightening pattern to effect a graduated brightening of the display over a predetermined time.

### Claim 7 (depends on 1)

The method of claim 1, wherein the ambient light history further includes luminance data, the method further comprising:
detecting a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history; and
applying a dimming pattern to effect a graduated dimming of the display over a predetermined time.

### Claim 8 (depends on 1)

The method of claim 1,
wherein the image source includes an associated display pipeline from which the display-ready image is read; and
wherein color-shifting at least the subset of the plurality of pixels occurs after the display-ready image is read from the display pipeline of the image source.

### Claim 9 (depends on 1)

The method of claim 1, wherein adjusting the manner in which the display-ready image is displayed includes modifying a gamma curve and/or background brightness level associated with the display.

### Claim 10 (depends on 1)

The method of claim 1, wherein adjusting the manner in which the display-ready image is displayed includes modifying color reproduction and/or peak luminance associated with the display-ready image.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
transmitting user profile data including the ambient light history, mode settings, and/or contextual data to one or more other computing devices each having a display to enable images displayed on the one or more other computing devices to be color-modified based on the transmitted user profile data.

### Claim 12

A portable electronic device, comprising:
a display;
a light sensor configured to sense an ambient light color condition;
a processor configured to execute an adaptive display module, the adaptive display module configured to:
determine an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by a light sensor;
read a display-ready image from an image source, the display-ready image having a plurality of pixels;
adjust a manner in which the display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image; and
display the color-modified image on the display.

### Claim 13 (depends on 12)

The portable electronic device of claim 12, wherein the light sensor is an ambient light sensor configured to detect a luminance and a correlated color temperature of ambient light.

### Claim 14 (depends on 12)

The portable electronic device of claim 12, wherein the sensor is a camera.

### Claim 15 (depends on 14)

The portable electronic device of claim 14,
wherein the camera is a front camera, the portable electronic device further comprising a rear camera configured to configured to capture ambient light; and
wherein the ambient light history includes a plurality of ambient light color conditions sensed over a duration of device operation by both the front camera and the rear camera.

### Claim 16 (depends on 12)

The portable electronic device of claim 12,
wherein the plurality of ambient color conditions includes a white point; and
wherein the adaptive display module is configured to adjust the white point of at least the subset of the plurality of pixels.

### Claim 17 (depends on 12)

The portable electronic device of claim 12, wherein the ambient light history further includes luminance data;
wherein the adaptive display module is configured to determine a display brightness change responsive to the luminance data; and
wherein the adaptive display module is configured to detect a threshold brightness decrease during a predetermined time period based on the luminance data in the ambient light history, and apply a dimming pattern to effect a graduated dimming of the display over a predetermined time.

### Claim 18 (depends on 12)

The portable electronic device of claim 12, wherein the ambient light history has a temporal duration of at least ten minutes.

### Claim 19

A method for adjusting a display to account for ambient light, the method comprising:
at a portable electronic device:
receiving ambient light data from an ambient light sensor, the ambient light data including ambient color data indicating an ambient light condition external to the portable electronic device;
receiving contextual data from a contextual data source;
reading a display-ready image from an image source, the display-ready image having a plurality of pixels;
modifying one or more properties of at least a subset of the plurality of pixels based on at least the ambient light data and the context data; and
displaying the modified image on a display.

### Claim 20 (depends on 19)

The method of claim 19, wherein the contextual data source is one or more of a global positioning system unit, a clock, and a weather module.
