# US 12,001,013 B2 · Pixel intensity modulation using modifying gain values

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,013 B2
- Document ID: US12001013B2
- Status: Granted
- Kind: B2
- Application number: 18/151,763
- Filed: 2023-01-09
- Published: 2023-05-25
- Granted: 2024-06-04
- Earliest claimed: 2018-07-02
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Richard Stephen Johnston; Brian T. Schowengerdt
- Web page: https://patentgrep.com/patent/US12001013B2

## CPC

- G02B 26/103: {having movable or deformable optical fibres, light guides or waveguides as scanning elements (light guides per se G02B6/00)}
- G02B 27/017: {Head mounted}
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 40/18: Eye characteristics, e.g. of the iris
- G09G 3/002: {to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT}
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0233: Improving the luminance or brightness uniformity across the screen
- G09G 2320/0285: using tables for spatial correction of display data
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A visual perception device has a look-up table stored in a laser driver chip. The look-up table includes relational gain data to compensate for brighter areas of a laser pattern wherein pixels are located more closely than areas where the pixels are further apart and to compensate for differences in intensity of individual pixels when the intensities of pixels are altered due to design characteristics of an eye piece.

## Claims

### Claim 1

A visual perception device comprising:
a data store;
relational gain data stored in the data store and representing a plurality of reference locations and a plurality of gain values, each gain value corresponding to a respective reference location;
a video data receiver connectable to a video data channel to receive video data including a plurality of pixels;
a correlator connected to the relational gain data and the video data receiver and operable to correlate each pixel with a reference location in the relational gain data to find a gain value corresponding to the respective pixel;
a beam modulator connected to the video data receiver and the correlator and operable to modify an intensity value of the respective pixel based on the gain value for the respective pixel to determine a modulated gain value for the respective pixel; and
a laser projector connected to the beam modulator and operable to generate a respective beam of light and transmit the beams of light in a pattern wherein the beams of light are spatially separated in two dimensions with the respective beams of light in the two dimensions being modulated according to the respective modulated gain values of each respective one of the pixels.

### Claim 2 (depends on 1)

The device of claim 1, further comprising:
a look-up table, wherein the relational gain data is stored in the look-up table.

### Claim 3 (depends on 1)

The device of claim 1, wherein the correlator is a pixel counter that counts the pixels in the video data and determines a respective reference location in the reference data based on the counting of the pixels, the relational gain data includes three different gain values for each reference location, each gain value corresponding to a different color, the video data includes a plurality of pixels for each of the three colors, and pixels of all three colors are correlated with reference locations in the relational gain data to find a gain value corresponding to the respective pixel.

### Claim 4 (depends on 1)

The device of claim 1, wherein the reference locations correspond to the pattern that is created by the projector.

### Claim 5 (depends on 4)

The device of claim 4, wherein first and second adjacent light beams in the pattern are further from one another than third and fourth light beams in the pattern and the gain values create more intensity for the first and second light beams than for the third and fourth light beams.

### Claim 6 (depends on 5)

The device of claim 5, wherein the laser projector travels faster from the first light beam to the second light beam in the pattern than from the third light beam to the fourth light beam in the pattern.

### Claim 7 (depends on 5)

The device of claim 5, wherein the pattern is a spiral pattern and the first and second light beams are in an outer region of the pattern compared to the third and fourth light beams in the pattern.

### Claim 8 (depends on 4)

The device of claim 4, further comprising:
an eye piece, the beams entering the eye piece, reflecting within the eye piece and exiting the eye piece, wherein the eye piece alters an intensity of the beams relative to one another and the gain values compensate for the eye piece altering the intensity of the beams relative to one another.

### Claim 9 (depends on 1)

The device of claim 1, wherein each pixel in the video data has as respective intensity value and the gain value in the relational data is a gain value that the beam modulator uses to modify the intensity value in the video data.

### Claim 10 (depends on 9)

The device of claim 9, further comprising:
a background camera that captures a background; and
a background analyzer connected to the background camera that determines at least one gain value based on the background, wherein the beam modulator uses the gain value based on the background to modify the intensity value in the video data.

### Claim 11 (depends on 10)

The device of claim 10, wherein the background analyzer determines at least a first gain value for a lighter area of the background and a second gain value for a darker area of the background and the modulator modifies the intensity value of respective pixels such that a pixel in the lighter area of the background has more intensity than a pixel in a darker area of the background.

### Claim 12 (depends on 9)

The device of claim 9, further comprising:
an eye camera that captures an eye; and
an eye analyzer connected to the eye camera that determines at least one gain value based on a gaze direction of a pupil of the eye, wherein the beam modulator uses the gain value based on the gaze direction of the pupil to modify the intensity value in the video data such that pixels in a gaze direction of the pupil have more intensity than pixels distant from the pupil.

### Claim 13 (depends on 12)

The device of claim 12, wherein the beam modulator reduces an intensity of pixels distant from the gaze direction of the pupil.

### Claim 14 (depends on 1)

The device of claim 1, wherein the beam modulator includes:
a video data digital-to-analog converter (VDAC) that receives the video data;
a gain digital-to-analog converter (GDAC) having an input for receiving a gain setting and an output connected to the VDAC to set a gain on the VDAC; and
a multiplier connected to the relational data to modify an output of the VDAC.

### Claim 15 (depends on 14)

The device of claim 14, wherein the multiplier multiplies the gain that is provided to the GDAC with the gain values of the pixels to modulate the gain that is provided to the GDAC.

### Claim 16 (depends on 14)

The device of claim 14, wherein the multiplier multiplies the gain that is provided to the VDAC with the gain values of the pixels to modulate the gain that is provided to the VDAC.

### Claim 17 (depends on 16)

The device of claim 16, wherein the VDAC is a first VDAC, further comprising:
a second VDAC, wherein the multiplier multiplies the gain that is provided to the second VDAC with the gain values of the pixels to modulate the gain that is provided to the VDAC; and
first and second current sources connected to and driven by the first and second VDAC's respectively, the current sources being connected in parallel.

### Claim 18 (depends on 1)

The device of claim 1 further comprising:
a laser driver chip, wherein the beam modulator and the relational gain data are located on the laser driver chip.