# US 2026/0017839 A1 · Image generation based on a generated prompt

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0017839 A1
- Document ID: US20260017839A1
- Status: Published application
- Kind: A1
- Application number: 18/769,506
- Filed: 2024-07-11
- Published: 2026-01-15
- Earliest claimed: 2024-07-11
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Nikolaos Vlassis; Anand Khanna; Ion Rosca; Chris Campbell; Oliver Brdiczka
- Web page: https://patentgrep.com/patent/US20260017839A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method, apparatus, non-transitory computer readable medium, and system for data processing include obtaining a text generation prompt and a target token indicating an image generation prompt attribute, generating an image generation prompt based on the text generation prompt and the target token, where the image generation prompt has the image generation prompt attribute, and generating a synthetic image based on the image generation prompt.

## Claims

### Claim 1

A method for image generation, comprising:
obtaining a text generation prompt and a target token indicating an image generation prompt attribute;
generating, using a language model, an image generation prompt based on the text generation prompt and the target token, wherein the image generation prompt has the image generation prompt attribute; and
generating, using an image generation model, a synthetic image based on the image generation prompt.

### Claim 2 (depends on 1)

The method of claim 1, wherein obtaining the target token comprises:
identifying a target attribute for the synthetic image; and
selecting the target token based on the target attribute.

### Claim 3 (depends on 1)

The method of claim 1, wherein obtaining the target token comprises:
receiving a user input indicating the image generation prompt attribute; and
selecting the target token based on the user input.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the image generation prompt attribute comprises an image description attribute, a vocabulary attribute, or a prompt length.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the target token comprises a nonce token used to train the language model.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
filtering the text generation prompt based on a content filter.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
filtering the image generation prompt based on a content filter.

### Claim 8 (depends on 1)

The method of claim 1, wherein generating the image generation prompt further comprises:
appending the target token to the text generation prompt to obtain an annotated text generation prompt, wherein the image generation prompt is generated based on the annotated text generation prompt.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the language model is trained to generate the image generation prompt having the image generation prompt attribute.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the language model is trained based on the synthetic image.

### Claim 11

A method for training a machine learning model, comprising:
obtaining training data comprising a training input text and a target token indicating an image generation prompt attribute; and
training, using the training data, a language model to generate an image generation prompt based on the training input text and the target token.

### Claim 12 (depends on 11)

The method of claim 11, wherein the training comprises:
generating, using an image generation model, a synthetic image based on an input prompt;
classifying the synthetic image according to an image attribute; and
classifying the input prompt according to the image attribute based on the classification of the synthetic image, wherein the training is based on the classification of the input prompt.

### Claim 13 (depends on 12)

The method of claim 12, wherein the training comprises:
computing an image attribute loss based on the classification of the input prompt; and
updating parameters of the language model based on the image attribute loss.

### Claim 14 (depends on 11)

The method of claim 11, wherein the training comprises:
generating, using the language model, a predicted image generation prompt;
computing a length of the predicted image generation prompt;
computing a length loss based on the length; and
updating parameters of the language model based on the length loss.

### Claim 15 (depends on 11)

The method of claim 11, wherein the training comprises:
generating, using the language model, a predicted image generation prompt;
determining whether the predicted image generation prompt includes inappropriate content;
computing a content loss based on the determination; and
updating parameters of the language model based on the content loss.

### Claim 16

A system for image generation, comprising:
at least one memory component;
at least one processor executing instructions stored in the at least one memory component;
a language model comprising text generation parameters stored in the at least one memory component, the language model trained to generate an image generation prompt based on a text generation prompt and a target token indicating an image generation prompt attribute, wherein the image generation prompt has the image generation prompt attribute; and
an image generation model comprising image generation parameters stored in the at least one memory component, the image generation model trained to generate a synthetic image based on the image generation prompt.

### Claim 17 (depends on 16)

The system of claim 16, further comprising:
a language verification component configured to filter the text generation prompt or the image generation prompt.

### Claim 18 (depends on 16)

The system of claim 16, further comprising:
a classification network configured to generate information for the target token.

### Claim 19 (depends on 16)

The system of claim 16, wherein:
the language model comprises a transformer model.

### Claim 20 (depends on 16)

The system of claim 16, wherein:
the image generation model comprises a diffusion model.
