# US 2026/0073625 A1 · Image processing apparatus and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073625 A1
- Document ID: US20260073625A1
- Status: Published application
- Kind: A1
- Application number: 19/331,304
- Filed: 2025-09-17
- Published: 2026-03-12
- Earliest claimed: 2024-09-09
- Assignees: Samsung Electronics Co., Ltd.; Research & Business Foundation Sungkyunkwan University
- Applicants: Samsung Electronics Co., Ltd.; Research & Business Foundation Sungkyunkwan University
- Inventors: Daesung CHO; Sungkil Lee; Seungho Park; Jaein Park; Younghoon Jeong
- Web page: https://patentgrep.com/patent/US20260073625A1

## CPC

- G06T 15/205: {Image-based rendering}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/20: using local operators
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/70: Denoising; Smoothing
- G06T 7/13: Edge detection
- G06T 7/136: involving thresholding
- G06T 7/55: from multiple images
- G06T 7/593: from stereo images
- H04N 13/00: Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N 13/122: Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence)
- H04N 13/128: Adjusting depth or disparity
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20216: Image averaging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus includes: at least one processor including processing circuitry; and memory including one or more storage media storing one or more instructions, where the at least one processor is configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to: obtain an input depth map from a two-dimensional (2D) input image, the input depth map including a boundary region and a non-boundary region of an object, perform first filtering on a first frame and a previous frame of the input depth map to obtain a first filtered depth map, by applying different weights to the boundary region and the non-boundary region, and generate a three-dimensional (3D) image, based on the first filtered depth map and the 2D input image.

## Claims

### Claim 1

An image processing apparatus comprising:
at least one processor comprising processing circuitry; and
memory comprising one or more storage media storing one or more instructions,
wherein the at least one processor is configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
obtain an input depth map from a two-dimensional (2D) input image, the input depth map comprising a boundary region and a non-boundary region of an object,
perform first filtering on a first frame and a previous frame of the input depth map to obtain a first filtered depth map, by applying different weights to the boundary region and the non-boundary region, and
generate a three-dimensional (3D) image, based on the first filtered depth map and the 2D input image.

### Claim 2 (depends on 1)

The image processing apparatus of claim 1, wherein, in performing the first filtering, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
detect the boundary region of the input depth map, and
apply a weighted average between the previous frame and the first frame, and
wherein, in the boundary region, a larger weight is applied to the first frame than the previous frame, and in the non-boundary region, a larger weight is applied to the previous frame than the first frame.

### Claim 3 (depends on 2)

The image processing apparatus of claim 2, wherein, in detecting the boundary region of the input depth map, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
based on the previous frame and the first frame, obtain first depth information comprising depth values of the boundary region and a background region,
based on the previous frame and the first frame, obtain second depth information comprising depth values of the boundary region and a foreground region, and
based on the first depth information and the second depth information, obtain third depth information comprising a depth value of the boundary region.

### Claim 4 (depends on 3)

The image processing apparatus of claim 3, wherein, in the performing the first filtering, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
by scaling the third depth information with a defined slope and limiting an upper limit and a lower limit, obtain a variable weight comprising a first weight value in the boundary region and a second weight value in the non-boundary region, and
wherein the first weight value in the boundary region is larger than the second weight value in the non-boundary region.

### Claim 5 (depends on 1)

The image processing apparatus of claim 1, wherein, in the boundary region of the first filtered depth map, the first frame is reflected more than the previous frame, and in the non-boundary region of the first filtered depth map, the previous frame is reflected more than the first frame.

### Claim 6 (depends on 1)

The image processing apparatus of claim 1, wherein the first filtered depth map comprises a foreground region and a background region, and
wherein the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to perform second filtering on the first filtered depth map, such that the foreground region of the first filtered depth map is blur-processed differently than the background region of the first filtered depth map.

### Claim 7 (depends on 6)

The image processing apparatus of claim 6, wherein, in performing the second filtering, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
generate a first depth map by blur-processing the first filtered depth map, and
generate a second depth map comprising a foreground region corresponding to the first depth map and a background region corresponding to the first filtered depth map, based on a maximum value calculation between the first depth map and the first filtered depth map.

### Claim 8 (depends on 7)

The image processing apparatus of claim 7, wherein, in the performing the second filtering, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to apply a weighted average between the second depth map and the first filtered depth map, and
wherein, in the foreground region, a larger weight is applied to the second depth map than the first filtered depth map, and in the background region, a larger weight is applied to the first filtered depth map than the second depth map.

### Claim 9 (depends on 7)

The image processing apparatus of claim 7, wherein, in generating the first depth map by blur-processing the first filtered depth map, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
generate a mipmap as a block unit comprising a sample pixel referenced for blur processing of a target pixel, and pixels adjacent to the sample pixel, and
perform depth map blur processing by using the target pixel and the mipmap.

### Claim 10 (depends on 1)

The image processing apparatus of claim 1, wherein, in generating the 3D image, the at least one processor is further configured to, individually or collectively, execute the one or more instructions to cause the image processing apparatus to:
generate, based on the first filtered depth map and the 2D input image, a 3D image for a left eye and a 3D image for a right eye,
perform hole filling for the 3D image for the left eye and the 3D image for the right eye, and
generate a binocular 3D image by combining the 3D image for the left eye and the 3D image for the right eye.

### Claim 11

An operating method of an image processing apparatus, the operating method comprising:
obtaining an input depth map from a two-dimensional (2D) input image, the input depth map including a boundary region and a non-boundary region of an object;
performing first filtering on a first frame and a previous frame of the input depth map to obtain a first filtered depth map, by applying different weights to the boundary region and the non-boundary region; and
generating a three-dimensional (3D) image, based on the first filtered depth map and the 2D input image.

### Claim 12 (depends on 11)

The operating method of claim 11, wherein the performing the first filtering comprises:
detecting the boundary region of the input depth map; and
applying a weighted average between the previous frame and the first frame, and
wherein, in the boundary region, a larger weight is applied to the first frame than the previous frame, and in the non-boundary region, a larger weight is applied to the previous frame than the first frame.

### Claim 13 (depends on 12)

The operating method of claim 12, wherein the detecting the boundary region of the input depth map comprises:
based on the previous frame and the first frame, obtaining first depth information including depth values of the boundary region and a background region;
based on the previous frame and the first frame, obtaining second depth information including depth values of the boundary region and a foreground region; and
based on the first depth information and the second depth information, obtaining third depth information including a depth value of the boundary region.

### Claim 14 (depends on 13)

The operating method of claim 13, wherein the performing the first filtering further comprises, by scaling the third depth information with a defined slope and limiting an upper limit and a lower limit, obtaining a variable weight including a first weight value in the boundary region and a second weight value in the non-boundary region, and
wherein the first weight value in the boundary region is greater than the second weight value in the non-boundary region.

### Claim 15 (depends on 11)

The operating method of claim 11, wherein, in the boundary region of the first filtered depth map, the first frame is reflected more than the previous frame, and in the non-boundary region of the first filtered depth map, the previous frame is reflected more than the first frame.

### Claim 16 (depends on 11)

The operating method of claim 11, wherein the first filtered depth map comprises a foreground region and a background region, and
wherein the method further comprises performing second filtering on the first filtered depth map, such that the foreground region is blur-processed differently than the background region.

### Claim 17 (depends on 16)

The operating method of claim 16, wherein the performing the second filtering further comprises:
generating a first depth map by blur-processing the first filtered depth map; and
generating a second depth map including a foreground region corresponding to the first depth map and a background region corresponding to the first filtered depth map, based on a maximum value calculation between the first depth map and the first filtered depth map.

### Claim 18 (depends on 17)

The operating method of claim 17, wherein the performing the second filtering further comprises applying a weighted average between the second depth map and the first filtered depth map, and
wherein, in the foreground region, a larger weight is applied to the second depth map than the first filtered depth map, and in the background region, a larger weight is applied to the first filtered depth map than the second depth map.

### Claim 19 (depends on 17)

The operating method of claim 17, wherein the generating the first depth map by blur-processing the first filtered depth map comprises:
generating a mipmap as a block unit including a sample pixel referenced for blur processing for a target pixel, and pixels adjacent to the sample pixel; and
performing depth map blur processing by using the target pixel and the mipmap.

### Claim 20 (depends on 11)

A non-transitory computer-readable recording medium having recorded thereon a program for performing the operating method of claim 11 on a computer.
