Method and apparatus with image processing based on neural diffusion

An electronic device comprising:

• one or more processors;
• and
• a memory storing instructions configured to cause the one or more processors to:
• set a randomness level for a target object;
• generate a noised image by performing a diffusion process of generating noise images while repeatedly performing noising based on a guide image of a guide domain including the target object and by extracting and saving, based on the randomness level, a partial preservation area from a noise image among the noise images;
• and
• obtain a denoised output image of a target domain by performing a reverse process of repeatedly generating, based on the randomness level, denoise images corresponding to the noise images and by applying the saved partial preservation area to a denoise image among the denoise images.

A method performed by a computing device, the method comprising:

• providing a semantically segmented guide image having an area of a target object, the target object having a randomness level associated therewith;
• performing noising based on the segmented guide image to generate a final noised image, the noising comprising generating an intermediate noised image corresponding to the randomness level, wherein the final noised image is generated by adding noise to the intermediate noised image;
• extracting and saving a region of the intermediate noised image that corresponds to the area of the target object;
• inputting the final noised image to a diffusion model which generates, based on the final noised image, a predicted final denoised image, wherein the predicted final denoised image is generated by:
• generating, by the diffusion model, an intermediate denoised image corresponding to the randomness level by replacing a region of the intermediate denoised image with the saved region of the intermediate noised image;
• and
• generating, by the diffusion model, the final denoised image based on the intermediate denoised image which includes the saved region of the intermediate noised image.