Prompt-based image relighting and editing

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component, the processing device to perform operations including:
• receiving a digital image that depicts a digital object, and a prompt that specifies a lighting condition and a background condition to be applied to the digital object;
• generating a relit digital object by:
• applying the lighting condition to the digital object using a diffusion model;
• and
• restoring content details to the digital object using a histogram matching operation;
• generating a background having a feature based on the background condition and on the relit digital object;
• and
• outputting an edited digital image that depicts the relit digital object with the background.

A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a digital image that depicts a digital object and lighting prompt that specifies a lighting condition to be applied to the digital object;
• generating a relit digital object that has the lighting condition applied to the digital object, the relit digital object generated by:
• removing a background from the digital image to extract the digital object;
• generating a lighting example image that has the lighting condition applied to a coarse representation of the digital object;
• and
• performing a histogram matching operation between the extracted digital object and the lighting example image to transfer a color profile from the lighting example image to the extracted digital object to generate the relit digital object;
• and
• outputting the relit digital object for display in a user interface.