# US 2018/0025521 A1 · Dynamic modulation for near eye display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025521 A1
- Document ID: US20180025521A1
- Status: Published application
- Kind: A1
- Application number: 15/547,469
- Filed: 2015-01-30
- Published: 2018-01-25
- Earliest claimed: 2015-01-30
- Assignees: Ent. Services Development Corporation LP
- Applicants: Ent. Services Development Corporation LP
- Inventors: William J. ALLEN; Kas KASRAVI
- Web page: https://patentgrep.com/patent/US20180025521A1

## CPC

- H04N 13/344: with head-mounted left-right displays
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- G06T 7/90: Determination of colour characteristics
- G09G 5/10: Intensity circuits
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

In example implementations, an amount of ambient light in a real world image is measured. An analysis of the virtual image is performed and a user preference for the virtual image is determined. A brightness level of the real world image is modulated based upon the amount of ambient light in the real world image that is measured. The virtual image is adjusted to optimize an appearance of the virtual image on a near eye display that is overlaid on the real world image based upon the analysis of the virtual image, the real world image that is modulated and the user preference for the virtual image.

## Claims

### Claim 1

A method, comprising:
measuring, by a processor, an amount of ambient light in a real world image;
performing, by the processor, an analysis of a virtual image;
determining, by the processor, a user preference for the virtual image;
modulating, by the processor, a brightness level of the real world image based upon the amount of ambient light in the real world image that is measured; and
adjusting, by the processor, the virtual image to optimize an appearance of the virtual image on a near eye display that is overlaid on the real world image based upon the analysis of the virtual image, the real world image that is modulated and the user preference for the virtual image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the near eye display comprises a display that projects the virtual image onto a retina of a user.

### Claim 3 (depends on 1)

The method of claim 1, wherein the user preference comprises: a brightness level, a preferred color or a contrast level.

### Claim 4 (depends on 1)

The method of claim 1, wherein the analysis comprises determining a type of image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the modulating is performed via a mechanical system or via an electrical system.

### Claim 6 (depends on 1)

The method of claim 1, wherein the adjusting comprises applying at least one of: a classic gamma function, a simple linear attenuation function or a sigmoid transfer function.

### Claim 7 (depends on 1)

The method of claim 1, wherein the measuring the amount of ambient light in the real world image further comprises:
measuring, by the processor, the amount of ambient light in different sub-regions of the real world image.

### Claim 8 (depends on 7)

The method of claim 7, wherein the adjusting the virtual image further comprises:
adjusting different sub-regions of the virtual image, wherein a different adjustment is performed in one or more of the different sub-regions of the virtual image to optimize each one of the different sub-regions of the virtual image that is overlaid on a corresponding one of the different sub-regions of the real world image.

### Claim 9

An apparatus comprising:
an image analysis block to analyze a virtual image;
a database to store a user preference for the virtual image;
a control determination block in communication with the database and the image analysis block to determine an amount of modulation based on an amount of ambient light in a real world image that is measured by an ambient light sensor and to determine an adjustment for the virtual image to optimize an appearance of the virtual image on a near eye display that is overlaid on the real world image based upon the virtual image that is analyzed, the real world image that is modulated and the user preference for the virtual image; and
an image processing block in communication with the control determination block to process the virtual image in accordance with the adjustment.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the near eye display comprises a display that projects the virtual image onto a retina of a user.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the user preference comprise: a brightness level, a preferred color or a contrast level.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the image analysis block analyzes the virtual image to determine a type of image.

### Claim 13 (depends on 9)

The apparatus of claim 9, further comprising:
a modulator in communication with the control determination block, wherein the modulator comprises a mechanical modulator or an electrical modulator.

### Claim 14

The apparatus of 9, wherein the adjustment comprises applying at least one of: a classic gamma function, a simple linear attenuation function, or a sigmoid transfer function.

### Claim 15

A head mounted video device, comprising:
a video camera to capture a real world image;
an ambient light sensor to measure an amount of ambient light in the real world image;
a processor coupled to the video camera and the ambient light sensor to perform an analysis of a virtual image, determine a user preference for the virtual image, determine an amount of modulation of a brightness level of the real world image based upon the ambient light in the real world image that is measured and adjust the virtual image to optimize an appearance that is overlaid on the real world image based upon the analysis of the virtual image, the real world image that is modulated and the user preference for the virtual image
a modulator coupled to the processor to modulate the real world image in accordance with the amount of modulation; and
a near eye display coupled to the processor and behind the modulator to display the virtual image that is optimized over the real world image that is modulated.
