# US 2026/0073495 A1 · Local tone mapping with noise reduction and edge preservation for video see-through (vst) extended reality (xr)

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073495 A1
- Document ID: US20260073495A1
- Status: Published application
- Kind: A1
- Application number: 19/063,059
- Filed: 2025-02-25
- Published: 2026-03-12
- Earliest claimed: 2024-09-06
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yingen Xiong; Christopher A. Peri
- Web page: https://patentgrep.com/patent/US20260073495A1

## CPC

- G06T 5/92: based on global image properties
- G06T 5/20: using local operators
- G06T 5/70: Denoising; Smoothing
- G06T 5/73: Deblurring; Sharpening
- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- G06T 15/005: {General purpose rendering architectures}
- G06T 15/20: Perspective computation
- G06T 17/205: {Re-meshing}
- G06T 2207/10024: Color image
- G06T 2207/20192: Edge enhancement; Edge preservation
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2210/32: Image data format
- G06T 2210/36: Level of detail
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes obtaining first image frames having a first dynamic range captured using at least one imaging sensor of a VST XR device. The method also includes, for each of at least one of the first image frames, generating a tone mapping filter configured to provide noise reduction and edge preservation while being guided by image and feature information and applying the tone mapping filter to the first image frame in order to transform the first image frame into a second image frame having a second dynamic range smaller than the first dynamic range. The tone mapping filter is applied to a luminance channel and not chrominance channels associated with the first image frame. The method further includes presenting one or more rendered images or videos based on the second image frame for each of at least one of the first image frames using at least one display.

## Claims

### Claim 1

An apparatus configured to be worn on a user's head, the apparatus comprising:
at least one imaging sensor configured to capture first image frames having a first dynamic range;
at least one processing device configured, for each of at least one of the first image frames, to:
generate a tone mapping filter configured to provide noise reduction and edge preservation while being guided by image and feature information; and
apply the tone mapping filter to the first image frame in order to transform the first image frame into a second image frame having a second dynamic range smaller than the first dynamic range, the tone mapping filter configured to be applied to a luminance channel associated with the first image frame and not chrominance channels associated with the first image frame; and
at least one display configured to present one or more rendered images or videos to the user based on the second image frame for each of at least one of the first image frames.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the image and feature information comprises, for each of the at least one of the first image frames, at least one of: image intensity information associated with the first image frame, image features associated with the first image frame, depth information associated with the first image frame, depth features associated with the first image frame, or spatial information associated with the first image frame.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the tone mapping filter is configured to perform contrast reduction filtering using different weights, the different weights associated with two or more of: the image intensity information, the image features, the depth information, the depth features, or the spatial information.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the at least one processing device is further configured, for each of the at least one of the first image frames, to perform a logarithm transformation and color conversion of the first image frame before generation of the tone mapping filter in order to convert the first image frame from a first image format that lacks luminance data to a second image format that includes luminance data.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein:
the at least one processing device is further configured, for each of the at least one of the first image frames, to map the first image frame to a rendering mesh before performance of the logarithm transformation and color conversion; and
the rendering mesh has a resolution that is lower than a resolution of the first image frame.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the at least one processing device is further configured, for each of the at least one of the first image frames, to:
use a combined look-up table that combines spatial information and weighting in order to map between source pixels of the first image frame and target pixels of the corresponding second image frame, the target pixels located on the rendering mesh; and
propagate values of the target pixels located on the rendering mesh to other pixels of the corresponding second image frame not located on the rendering mesh.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the at least one processing device is further configured, for each of the at least one of the first image frames, to:
apply a passthrough transformation, display lens correction, and chromatic aberration correction to the second image frame in order to generate a corrected second image frame; and
render the corrected second image frame.

### Claim 8

A method comprising:
obtaining first image frames having a first dynamic range captured using at least one imaging sensor of a video see-through (VST) extended reality (XR) device;
for each of at least one of the first image frames:
generating a tone mapping filter configured to provide noise reduction and edge preservation while being guided by image and feature information; and
applying the tone mapping filter to the first image frame in order to transform the first image frame into a second image frame having a second dynamic range smaller than the first dynamic range, the tone mapping filter applied to a luminance channel associated with the first image frame and not chrominance channels associated with the first image frame; and
presenting one or more rendered images or videos based on the second image frame for each of at least one of the first image frames using at least one display of the VST XR device.

### Claim 9 (depends on 8)

The method of claim 8, wherein the image and feature information comprises, for each of the at least one of the first image frames, at least one of: image intensity information associated with the first image frame, image features associated with the first image frame, depth information associated with the first image frame, depth features associated with the first image frame, or spatial information associated with the first image frame.

### Claim 10 (depends on 9)

The method of claim 9, wherein the tone mapping filter performs contrast reduction filtering using different weights, the different weights associated with two or more of: the image intensity information, the image features, the depth information, the depth features, or the spatial information.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
for each of the at least one of the first image frames, performing a logarithm transformation and color conversion of the first image frame before generating the tone mapping filter in order to convert the first image frame from a first image format that lacks luminance data to a second image format that includes luminance data.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
for each of the at least one of the first image frames, mapping the first image frame to a rendering mesh before performing the logarithm transformation and color conversion;
wherein the rendering mesh has a resolution that is lower than a resolution of the first image frame.

### Claim 13 (depends on 12)

The method of claim 12, further comprising, for each of the at least one of the first image frames:
using a combined look-up table that combines spatial information and weighting in order to map between source pixels of the first image frame and target pixels of the corresponding second image frame, the target pixels located on the rendering mesh; and
propagating values of the target pixels located on the rendering mesh to other pixels of the corresponding second image frame not located on the rendering mesh.

### Claim 14 (depends on 8)

The method of claim 8, further comprising, for each of the at least one of the first image frames:
applying a passthrough transformation, display lens correction, and chromatic aberration correction to the second image frame in order to generate a corrected second image frame; and
rendering the corrected second image frame.

### Claim 15

A non-transitory machine readable medium containing instructions that when executed cause at least one processor of a video see-through (VST) extended reality (XR) device to:
obtain first image frames having a first dynamic range captured using at least one imaging sensor of the VST XR device;
for each of at least one of the first image frames:
generate a tone mapping filter configured to provide noise reduction and edge preservation while being guided by image and feature information; and
apply the tone mapping filter to the first image frame in order to transform the first image frame into a second image frame having a second dynamic range smaller than the first dynamic range, the tone mapping filter configured to be applied to a luminance channel associated with the first image frame and not chrominance channels associated with the first image frame; and
initiate display of one or more rendered images or videos based on the second image frame for each of at least one of the first image frames using at least one display of the VST XR device.

### Claim 16 (depends on 15)

The non-transitory machine readable medium of claim 15, wherein the image and feature information comprises, for each of the at least one of the first image frames, at least one of: image intensity information associated with the first image frame, image features associated with the first image frame, depth information associated with the first image frame, depth features associated with the first image frame, or spatial information associated with the first image frame.

### Claim 17 (depends on 16)

The non-transitory machine readable medium of claim 16, wherein the tone mapping filter is configured to perform contrast reduction filtering using different weights, the different weights associated with two or more of: the image intensity information, the image features, the depth information, the depth features, or the spatial information.

### Claim 18 (depends on 15)

The non-transitory machine readable medium of claim 15, further containing instructions that when executed cause the at least one processor, for each of the at least one of the first image frames, to:
map the first image frame to a rendering mesh; and
perform a logarithm transformation and color conversion before generation of the tone mapping filter in order to convert the first image frame from a first image format that lacks luminance data to a second image format that includes luminance data;
wherein the rendering mesh has a resolution that is lower than a resolution of the first image frame.

### Claim 19 (depends on 18)

The non-transitory machine readable medium of claim 18, further containing instructions that when executed cause the at least one processor, for each of the at least one of the first image frames, to:
use a combined look-up table that combines spatial information and weighting in order to map between source pixels of the first image frame and target pixels of the corresponding second image frame, the target pixels located on the rendering mesh; and
propagate values of the target pixels located on the rendering mesh to other pixels of the corresponding second image frame not located on the rendering mesh.

### Claim 20 (depends on 15)

The non-transitory machine readable medium of claim 15, further containing instructions that when executed cause the at least one processor, for each of the at least one of the first image frames, to:
apply a passthrough transformation, display lens correction, and chromatic aberration correction to the second image frame in order to generate a corrected second image frame; and
render the corrected second image frame.
