Interactive diffusion-based texture editing

A system comprising:

• a memory component including an image-conditioned diffusion model;
• and
• a processing device coupled to the memory component to perform operations comprising:
• accessing a texture image and a textual prompt corresponding to the texture image;
• computing, using the image-conditioned diffusion model, image embeddings corresponding to the textual prompt;
• defining, using the image embeddings, a varying appearance of the texture image, the varying appearance corresponding to the textual prompt;
• and
• presenting the varying appearance of the texture image for display in an interactive texture editing element.

A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• accessing a texture image and a textual prompt corresponding to the texture image;
• a step for defining, using an image-conditioned diffusion model, a varying appearance of the texture image, the varying appearance corresponding to the textual prompt;
• and
• presenting the varying appearance of the texture image for display in an interactive texture editing element.