# US 2025/0095117 A1 · Method and apparatus with image processing based on neural diffusion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095117 A1
- Document ID: US20250095117A1
- Status: Published application
- Kind: A1
- Application number: 18/660,030
- Filed: 2024-05-09
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Seongeun KIM; Seohyung LEE
- Web page: https://patentgrep.com/patent/US20250095117A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/60: using machine learning, e.g. neural networks
- G06V 10/40: Extraction of image or video features
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and apparatus with image processing based on neural diffusion are provided. The method includes: setting a randomness level for a target object; generating a noised image by performing a diffusion process of generating noise images while repeatedly performing noising based on a guide image of a guide domain including the target object and by extracting and saving, based on the randomness level, a partial preservation area from a noise image among the noise images; and obtaining a denoised output image of a target domain by performing a reverse process of repeatedly generating, based on the noised image, denoise images corresponding to the noise images and by applying the saved partial preservation area to a denoise image among the denoise images.

## Claims

### Claim 1

An image processing method performed by a computing device, the method comprising:
setting a randomness level for a target object;
generating a noised image by performing a diffusion process of generating noise images while repeatedly performing noising based on a guide image of a guide domain including the target object and by extracting and saving, based on the randomness level, a partial preservation area from a noise image among the noise images; and
obtaining a denoised output image of a target domain by performing a reverse process of repeatedly generating, based on the noised image, denoise images corresponding to the noise images and by applying the saved partial preservation area to a denoise image among the denoise images.

### Claim 2 (depends on 1)

The image processing method of claim 1, wherein the noise image is selected, from among the noise images, to have the partial region extracted therefrom, and wherein the selecting is based on the noise image having a noise level corresponding to the randomness level of the target object.

### Claim 3 (depends on 1)

The image processing method of claim 1, wherein the applying the saved partial preservation area to the denoise image comprises replacing, in the denoise image, a partial replacement area corresponding to the target object with the saved partial preservation area.

### Claim 4 (depends on 1)

The image processing method of claim 1, wherein
the randomness level is set based on a property of the guide image and a type of the target object.

### Claim 5 (depends on 1)

The image processing method of claim 1, wherein
characteristics of the guide domain of the target object and characteristics of the target domain of the target object in the output image are expressed in a mixture, according to the randomness level.

### Claim 6 (depends on 1)

The image processing method of claim 1, wherein
the higher the randomness level of the target object, the stronger are characteristics of the target domain of the target object are expressed in the output image relative to characteristics of the guide domain of the target object.

### Claim 7 (depends on 1)

The image processing method of claim 1, wherein
the reverse process is performed using a diffusion model that comprises a neural network.

### Claim 8 (depends on 7)

The image processing method of claim 7, wherein
the diffusion model is configured to perform the reverse process based on the noised image and based on a semantically segmented condition image.

### Claim 9 (depends on 8)

The image processing method of claim 8, wherein
the diffusion model is configured to adjust intensity of application of the reverse process based on a condition coefficient.

### Claim 10 (depends on 9)

The image processing method of claim 9, wherein
the condition coefficient is set based on the randomness level.

### Claim 11 (depends on 1)

The image processing method of claim 1, wherein the saved partial preservation area replaces a corresponding area in the denoise image, and wherein the denoise image is selected for the partial area replacement based on the randomness level.

### Claim 12

An electronic device comprising:
one or more processors; and
a memory storing instructions configured to cause the one or more processors to:
set a randomness level for a target object;
generate a noised image by performing a diffusion process of generating noise images while repeatedly performing noising based on a guide image of a guide domain including the target object and by extracting and saving, based on the randomness level, a partial preservation area from a noise image among the noise images; and
obtain a denoised output image of a target domain by performing a reverse process of repeatedly generating, based on the randomness level, denoise images corresponding to the noise images and by applying the saved partial preservation area to a denoise image among the denoise images.

### Claim 13 (depends on 12)

The electronic device of claim 12, wherein the instructions are further configured to cause the one or more processors to:
select the noise image from among the noise images based on the noise image having a noise level corresponding to the randomness level.

### Claim 14 (depends on 12)

The electronic device of claim 12, wherein the instructions are further configured to cause the one or more processors to:
select the denoise image, from among the denoise images, for application of the saved partial preservation area, wherein he selecting is based on the denoise image having a noise level corresponding to the randomness level.

### Claim 15 (depends on 12)

The electronic device of claim 12, wherein
the randomness level is set based on a property of the guide image and based on a type of the target object.

### Claim 16 (depends on 12)

The electronic device of claim 12, wherein
characteristics of the guide domain of the target object and characteristics of the target domain of the target object in the output image are expressed in a mixture, according to the randomness level.

### Claim 17 (depends on 12)

The electronic device of claim 12, wherein
the reverse process is performed using a diffusion model that comprises a neural network.

### Claim 18 (depends on 17)

The method of claim 17, wherein
the diffusion model is configured to perform the reverse process based on the noised image and based on a semantically segmented condition image.

### Claim 19 (depends on 18)

The method of claim 18, wherein
the diffusion model is configured to adjust intensity of application of the reverse process based on a condition coefficient, and
wherein the condition coefficient is set based on the randomness level.

### Claim 20

A method performed by a computing device, the method comprising:
providing a semantically segmented guide image having an area of a target object, the target object having a randomness level associated therewith;
performing noising based on the segmented guide image to generate a final noised image, the noising comprising generating an intermediate noised image corresponding to the randomness level, wherein the final noised image is generated by adding noise to the intermediate noised image;
extracting and saving a region of the intermediate noised image that corresponds to the area of the target object;
inputting the final noised image to a diffusion model which generates, based on the final noised image, a predicted final denoised image, wherein the predicted final denoised image is generated by:
generating, by the diffusion model, an intermediate denoised image corresponding to the randomness level by replacing a region of the intermediate denoised image with the saved region of the intermediate noised image; and
generating, by the diffusion model, the final denoised image based on the intermediate denoised image which includes the saved region of the intermediate noised image.
