# US 2023/0267677 A1 · Spatially-resolved dynamic dimming for augmented reality device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267677 A1
- Document ID: US20230267677A1
- Status: Published application
- Kind: A1
- Application number: 18/140,783
- Filed: 2023-04-28
- Published: 2023-08-24
- Earliest claimed: 2018-08-31
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Vaibhav Mathur; David Manly; Jahja I. Trisnadi; Clinton Carlisle; Lionel Ernest Edwin; Michael Anthony Klug
- Web page: https://patentgrep.com/patent/US20230267677A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 15/506: {Illumination models}
- G02B 27/0172: {characterised by optical features}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 15/80: Shading
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06T 2215/16: Using real world measurements to influence rendering
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

## Claims

### Claim 1

A method of operating a dimmer of an optical system, the method comprising:
receiving, at the optical system, light associated with a world object;
generating, at a projector of the optical system, virtual image light to be projected onto an eyepiece of the optical system, the virtual image light representing one or more virtual objects to be displayed;
projecting the virtual image light onto the eyepiece;
for each pixel of a plurality of pixels of the dimmer:
determining a brightness of the virtual image light at the pixel; and
calculating a dimming value for the pixel based on the brightness of the virtual image light at the pixel, the dimming value being one of a plurality of spatially-resolved dimming values; and
adjusting the dimmer in accordance with the plurality of spatially-resolved dimming values to reduce an intensity of the light associated with the world object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the plurality of spatially-resolved dimming values include at least two unique levels of dimming.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
for each pixel of the plurality of pixels of the dimmer:
determining a brightness of the light associated with the world object at the pixel, wherein the dimming value for the pixel is calculated further based on the brightness of the light associated with the world object at the pixel.

### Claim 4 (depends on 3)

The method of claim 3, wherein the dimming value for the pixel is calculated further based on a desired contrast for the one or more virtual objects.

### Claim 5 (depends on 3)

The method of claim 3, wherein the dimming value for the pixel is calculated further based on a desired visibility for the one or more virtual objects.

### Claim 6 (depends on 3)

The method of claim 3, wherein the optical system comprises a light sensor configured to detect the brightness of the light associated with the world object at the pixel.

### Claim 7 (depends on 1)

The method of claim 1, wherein the optical system comprises a wearable augmented reality (AR) device.

### Claim 8

A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform operations comprising:
generating, at a projector of an optical system, virtual image light to be projected onto an eyepiece of the optical system, the virtual image light representing one or more virtual objects to be displayed;
projecting the virtual image light onto the eyepiece;
for each pixel of a plurality of pixels of a dimmer of the optical system:
determining a brightness of the virtual image light at the pixel; and
calculating a dimming value for the pixel based on the brightness of the virtual image light at the pixel, the dimming value being one of a plurality of spatially-resolved dimming values; and
adjusting the dimmer in accordance with the plurality of spatially-resolved dimming values to reduce an intensity of light associated with a world object received at the optical system.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the plurality of spatially-resolved dimming values include at least two unique levels of dimming.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the operations further comprise:
for each pixel of the plurality of pixels of the dimmer:
determining a brightness of the light associated with the world object at the pixel, wherein the dimming value for the pixel is calculated further based on the brightness of the light associated with the world object at the pixel.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the dimming value for the pixel is calculated further based on a desired contrast for the one or more virtual objects.

### Claim 12 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the dimming value for the pixel is calculated further based on a desired visibility for the one or more virtual objects.

### Claim 13 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the optical system comprises a light sensor configured to detect the brightness of the light associated with the world object at the pixel.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the optical system comprises a wearable augmented reality (AR) device.

### Claim 15

A system comprising:
one or more processors; and
a computer-readable medium comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
generating, at a projector of an optical system, virtual image light to be projected onto an eyepiece of the optical system, the virtual image light representing one or more virtual objects to be displayed;
projecting the virtual image light onto the eyepiece;
for each pixel of a plurality of pixels of a dimmer of the optical system:
determining a brightness of the virtual image light at the pixel; and
calculating a dimming value for the pixel based on the brightness of the virtual image light at the pixel, the dimming value being one of a plurality of spatially-13 resolved dimming values; and
adjusting the dimmer in accordance with the plurality of spatially-resolved dimming values to reduce an intensity of light associated with a world object received at the optical system.

### Claim 16 (depends on 15)

The system of claim 15, wherein the plurality of spatially-resolved dimming values include at least two unique levels of dimming.

### Claim 17 (depends on 15)

The system of claim 15, wherein the operations further comprise:
for each pixel of the plurality of pixels of the dimmer:
determining a brightness of the light associated with the world object at the pixel, wherein the dimming value for the pixel is calculated further based on the brightness of the light associated with the world object at the pixel.

### Claim 18 (depends on 17)

The system of claim 17, wherein the dimming value for the pixel is calculated further based on a desired contrast for the one or more virtual objects.

### Claim 19 (depends on 17)

The system of claim 17, wherein the dimming value for the pixel is calculated further based on a desired visibility for the one or more virtual objects.

### Claim 20 (depends on 17)

The system of claim 17, wherein the optical system comprises a light sensor configured to detect the brightness of the light associated with the world object at the pixel.
