In-context image generation using style images

A non-transitory computer readable medium storing code for image processing, the code comprising instructions executable by a processor to perform operations comprising:

• obtaining a text prompt and a preliminary style image, wherein the text prompt describes an image element and the preliminary style image includes a region with a target style;
• extracting the region with the target style from the preliminary style image to obtain a style image;
• and
• generating, using an image generation model, a synthetic image based on the text prompt and the style image, wherein the synthetic image depicts the image element with the target style.

An apparatus comprising:

• a memory component;
• a processing device coupled to the memory component;
• an extraction component comprising parameters stored in the memory component and configured to extract a region with a target style from a preliminary style image to obtain a style image;
• and
• an image generation model comprising parameters stored in the memory component and trained to generate a synthetic image based on a text prompt and the style image, wherein the synthetic image depicts an image element from the text prompt with the target style.