Saliency-based background generation

A system, comprising:

• a processing device;
• and
• a computer-readable medium storing instructions that, responsive to execution by the processing device, cause the processing device to perform operations including:
• receiving multiple images depicting an object;
• extracting, using a tag extraction model, image tags from the multiple images;
• generating, using a generative text model, a prompt based on the image tags;
• generating, using a generative image model, a background image based on the prompt;
• generating an output image by incorporating the object into the background image;
• determining, using a visual saliency model, a visual saliency defining a degree of fixation on the object within the output image;
• and
• outputting the output image based on the visual saliency meeting a threshold.

A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• obtaining, from an online publication of an object, textual information describing the object;
• extracting, using an entity extraction technique, one or more entities that correspond to the textual information from a knowledge graph that indicates associations between entities;
• generating, using a generative text model, a prompt based on the one or more entities;
• generating, using a generative image model, a background image based on the prompt;
• generating an output image by incorporating the object into the background image;
• determining, using a visual saliency model, a visual saliency defining a degree of fixation on the object within the output image;
• and
• outputting the output image based on the visual saliency meeting a threshold.