Methods and systems for generating text with tone or diction corresponding to stylistic attributes of images
OwnerRuss MASCHMEYERinventor
Life of this patent
Estimating the term…
Abstract
Methods and systems for prompting a large language model (LLM) to generate a stylistic description of an image are disclosed. One or more visual attributes are extracted from an image using a first trained machine learning model. The visual attributes are mapped to one or more emotion attributes using a second trained machine learning model. A LLM prompt is generated based on the one or more emotion attributes and provided to the LLM. A generated description of the image is obtained from the LLM and displayed with the image.
Claims25
A system comprising:
- a processing unit configured to execute instructions to cause the system to:
- extract, from an image, one or more visual attributes of the image using a first trained machine learning model;
- map the one or more visual attributes to one or more emotion attributes using a second trained machine learning model;
- generate a prompt to a large language model (LLM), the prompt being based on the one or more emotion attributes;
- provide the generated prompt to the LLM;
- and
- obtain, from the LLM, a generated description of the image.
A computer-implemented method comprising:
- extracting, from an image, one or more visual attributes of the image using a first trained machine learning model;
- mapping the one or more visual attributes to one or more emotion attributes using a second trained machine learning model;
- generating a prompt to a large language model (LLM), the prompt being based on the one or more emotion attributes;
- providing the generated prompt to the LLM;
- and
- obtaining, from the LLM, a generated description of the image.
A non-transitory computer-readable medium storing instructions that, when executed by a processor of a system, causes the system to:
- extract, from an image, one or more visual attributes of the image using a first trained machine learning model;
- map the one or more visual attributes to one or more emotion attributes using a second trained machine learning model;
- generate a prompt to a large language model (LLM), the prompt being based on the one or more emotion attributes;
- provide the generated prompt to the LLM;
- and
- obtain, from the LLM, a generated description of the image.
Dependencies are inferred from the claim text.