Machine-learning prompt enhancement
AssigneeAdobe Inc.
InventorsDhwanit Agarwal, Shradha Agrawal, Deepak Pai, Ambareesh Revanur
Life of this patent
Estimating the term…
Abstract
Machine-learning prompt enhancement techniques are described. In one or more examples, by generating training data from high-quality digital content meeting specific criteria, a generative artificial intelligence (AI) system is configurable to train an enhancement machine-learning model to capture features pertaining to particular tasks or scenarios. The trained enhancement machine-learning model can then extract enhancement features from inputs, enabling the formation of enhanced prompts that guide generative AI models to generate digital content as suitable for the particular tasks or scenarios.
Claims20
A method comprising:
- receiving, by a processing device, an input having text describing generative digital content;
- extracting, by the processing device, enhancement features based on the input using an enhancement machine-learning model configured as a diffusion transformer;
- forming, by the processing device, an enhanced prompt based on the enhancement features and a prompt refinement query, the forming using a prompt refinement machine-learning model implemented as a language model;
- and
- presenting, by the processing device, the generative digital content for display in a user interface, the generative digital content generated using generative artificial intelligence (AI) implemented using one or more machine-learning models based on the enhanced prompt.
A computing device comprising:
- a processing device;
- and
- a computer-readable storage medium storing instructions that, responsive to execution by the processing device, causes the processing device to perform operations including:
- identifying a set of digital content from a plurality of digital content meeting one or more criteria;
- generating a plurality of content descriptions, respectively, for the set of digital content using at least one machine-learning model;
- and
- training an enhancement machine-learning model using the plurality of content descriptions and the plurality of digital content using a loss function to implement the one or more criteria as part of digital content generation using generative artificial intelligence (AI).
One or more computer-readable storage media storing instructions that, responsive to execution by a processing device, causes the processing device to perform operations comprising:
- extracting enhancement features based on an input using an enhancement machine-learning model;
- forming an enhanced prompt based on the enhancement features and a prompt refinement query, the forming using a prompt refinement machine-learning model implemented as a language model;
- communicating the enhanced prompt to at least one machine-learning model to generate generative digital content using generative artificial intelligence (AI);
- and
- receiving the generative digital content for display in a user interface.
Dependencies are inferred from the claim text.