Generating digital images in new contexts while preserving color and composition using diffusion neural networks

A system comprising:

• a memory component;
• and
• one or more processing devices coupled to the memory component, the one or more processing devices to perform operations comprising:
• identifying a digital image depicting initial image content reflecting a color harmony defining colors within the digital image and an image composition defining an arrangement of visual elements within the digital image;
• generating a blurred digital image by blurring pixels of the digital image to obscure the initial image content while retaining the color harmony and the image composition;
• and
• generating, utilizing a diffusion neural network with the blurred digital image as initial noise, a new digital image depicting new image content reflecting the color harmony and the image composition of the digital image.

A non-transitory computer readable medium storing instructions which, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving, via user input, a text prompt defining query image content and a sample digital image depicting a color harmony;
• generating a blurred digital image by blurring pixels of the sample digital image while preserving the color harmony;
• and
• generating, utilizing a diffusion neural network, a modified digital image depicting the query image content having the color harmony of the sample digital image by denoising the blurred digital image toward a noise vector of the text prompt.