# US 2024/0177400 A1 · Texture opacity optimizations for optical see-through ar displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177400 A1
- Document ID: US20240177400A1
- Status: Published application
- Kind: A1
- Application number: 18/432,970
- Filed: 2024-02-05
- Published: 2024-05-30
- Earliest claimed: 2024-02-05
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Akshay Jindal
- Web page: https://patentgrep.com/patent/US20240177400A1

## CPC

- G06T 15/04: Texture mapping
- G02B 27/017: {Head mounted}
- G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems, apparatuses and methods may provide for technology that determines a texture similarity between a target output image and an initial rendered image, updates one or more scene parameters to increase the texture similarity between the target output image and the initial rendered image, generates a modified rendered image based on the updated scene parameter(s), and sends the modified rendered image to one or more displays of an augmented reality (AR) headset, wherein the modified rendered image visually blends with an environmental image to obtain the target output image.

## Claims

### Claim 1

An augmented reality (AR) headset comprising:
one or more displays;
a processor coupled to the one or more displays; and
a memory coupled to the processor, the memory including a set of instructions, which when executed by the processor, cause the processor to:
determine a texture similarity between a target output image and an initial rendered image,
update one or more scene parameters to increase the texture similarity between the target output image and the initial rendered image,
generate a modified rendered image based on the updated one or more scene parameters, and
send the modified rendered image to the one or more displays, wherein the modified rendered image is to visually blend with an environmental image to obtain the target output image.

### Claim 2 (depends on 1)

The AR headset of claim 1, wherein an opacity of the modified rendered image in the target output image exceeds a threshold.

### Claim 3 (depends on 1)

The AR headset of claim 1, wherein the one or more scene parameters are to include texture maps.

### Claim 4 (depends on 1)

The AR headset of claim 1, wherein the one or more scene parameters are updated based on a peak luminance of the one or more displays.

### Claim 5 (depends on 1)

The AR headset of claim 1, wherein the one or more scene parameters are updated with respect to an entirety of the target output image.

### Claim 6 (depends on 1)

The AR headset of claim 1, further including:
a left eye camera; and
a right eye camera, wherein the instructions, when executed, further cause the processor to obtain the second environmental image from one or more of the left eye camera or the right eye camera.

### Claim 7

At least one computer readable storage medium comprising a set of instructions, which when executed by an augmented reality (AR) headset, cause the AR headset to:
determine a texture similarity between a target output image and an initial rendered image;
update one or more scene parameters to increase the texture similarity between the target output image and the initial rendered image;
generate a modified rendered image based on the updated one or more scene parameters; and
send the modified rendered image to one or more displays of the AR headset, wherein the modified rendered image is to visually blend with an environmental image to obtain the target output image.

### Claim 8 (depends on 7)

The at least one computer readable storage medium of claim 7, wherein an opacity of the modified rendered image in the target output image exceeds a threshold.

### Claim 9 (depends on 7)

The at least one computer readable storage medium of claim 7, wherein the one or more scene parameters are to include texture maps.

### Claim 10 (depends on 7)

The at least one computer readable storage medium of claim 7, wherein the one or more scene parameters are updated based on a peak luminance of the one or more displays.

### Claim 11 (depends on 7)

The at least one computer readable storage medium of claim 7, wherein the one or more scene parameters are updated with respect to an entirety of the target output image.

### Claim 12 (depends on 7)

The at least one computer readable storage medium of claim 7, wherein the instructions, when executed, further cause the AR headset to obtain the environmental image from a camera of the AR headset.

### Claim 13 (depends on 12)

The at least one computer readable storage medium of claim 12, wherein the environmental image is obtained from a left eye camera.

### Claim 14 (depends on 12)

The at least one computer readable storage medium of claim 12, wherein the environmental image is obtained from a right eye camera.

### Claim 15

A method comprising:
determining a texture similarity between a target output image and an initial rendered image;
updating one or more scene parameters to increase the texture similarity between the target output image and the initial rendered image;
generating a modified rendered image based on the updated one or more scene parameters; and
sending the modified rendered image to one or more displays of an augmented reality (AR) headset, wherein the modified rendered image visually blends with an environmental image to obtain the target output image.

### Claim 16 (depends on 15)

The method of claim 15, wherein an opacity of the modified rendered image in the target output image exceeds a threshold.

### Claim 17 (depends on 15)

The method of claim 15, wherein the one or more scene parameters include texture maps.

### Claim 18 (depends on 15)

The method of claim 15, wherein the one or more scene parameters are updated based on a peak luminance of a display.

### Claim 19 (depends on 15)

The method of claim 15, wherein the one or more scene parameters are updated with respect to an entirety of the target output image.

### Claim 20 (depends on 15)

The method of claim 15, further including obtaining the environmental image one or more of a left eye camera or a right eye camera.
