Prompt generation for generative artificial intelligence models

A computer-implemented method for generating a prompt for a generative machine learning model, the method comprising:

• receiving a text prompt;
• encoding, by an encoder implementing an encoding process, the received text prompt into a text embedding;
• identifying one or more similar text embeddings to the encoded received text prompt from a database of text embeddings, wherein the text embeddings in the database comprise or consist of training captions that were used to train the generative machine learning model encoded using the encoding process;
• retrieving one or more training captions corresponding to the identified one or more similar text embeddings;
• and
• generating a modified prompt based on the retrieved training captions.

Non-transitory storage storing instructions executable by one or more processing units to cause the one or more processing units to perform a method, the method comprising:

• receiving a text prompt;
• encoding, by an encoder implementing an encoding process, the received text prompt into a text embedding;
• identifying one or more similar text embeddings to the encoded text prompt from a database of text embeddings, wherein the text embeddings in the database comprise or consist of training captions that were used to train the generative machine learning model encoded using the encoding process;
• retrieving one or more training captions corresponding to the identified one or more similar text embeddings;
• and
• generating a modified prompt based on the retrieved training captions.