Synthesizing shadows in digital images utilizing diffusion models

A system comprising:

• one or more memory devices comprising a shadow synthesis diffusion model;
• and
• one or more processors configured to cause the system to:
• receive a digital image depicting a scene;
• access one or more object masks from one or more objects corresponding to one or more locations with visible textures;
• and
• generate, utilizing the shadow synthesis diffusion model, the digital image with one or more shadows for the one or more objects consistent with the scene by:
• combining an object mask of the one or more object masks, the digital image, and a noise representation to generate a combined representation;
• generating, utilizing an iterative denoising process of the shadow synthesis diffusion model, a denoised representation of the combined representation;
• and
• generating, from the denoised representation, the digital image comprising a shadow for an object of the one or more objects with a visible texture in a location of the one or more locations preserved.

A non-transitory computer-readable medium storing executable instructions which, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a digital image depicting a scene;
• accessing an object mask of an object in a location depicted within the digital image;
• combining the object mask of the object, the digital image, and a noise representation to generate a combined representation;
• and
• generating, utilizing a shadow synthesis diffusion model, a composite digital image that includes a shadow of the object with a visible texture of the location preserved.