Image generation based on a generated prompt
AssigneeAdobe Inc.
InventorsNikolaos Vlassis, Anand Khanna, Ion Rosca, Chris Campbell, Oliver Brdiczka
Life of this patent
Estimating the term…
Abstract
A method, apparatus, non-transitory computer readable medium, and system for data processing include obtaining a text generation prompt and a target token indicating an image generation prompt attribute, generating an image generation prompt based on the text generation prompt and the target token, where the image generation prompt has the image generation prompt attribute, and generating a synthetic image based on the image generation prompt.
Claims20
A method for image generation, comprising:
- obtaining a text generation prompt and a target token indicating an image generation prompt attribute;
- generating, using a language model, an image generation prompt based on the text generation prompt and the target token, wherein the image generation prompt has the image generation prompt attribute;
- and
- generating, using an image generation model, a synthetic image based on the image generation prompt.
A method for training a machine learning model, comprising:
- obtaining training data comprising a training input text and a target token indicating an image generation prompt attribute;
- and
- training, using the training data, a language model to generate an image generation prompt based on the training input text and the target token.
A system for image generation, comprising:
- at least one memory component;
- at least one processor executing instructions stored in the at least one memory component;
- a language model comprising text generation parameters stored in the at least one memory component, the language model trained to generate an image generation prompt based on a text generation prompt and a target token indicating an image generation prompt attribute, wherein the image generation prompt has the image generation prompt attribute;
- and
- an image generation model comprising image generation parameters stored in the at least one memory component, the image generation model trained to generate a synthetic image based on the image generation prompt.
Dependencies are inferred from the claim text.