# US 2025/0157093 A1 · Visual Object Consistency in Image Generation Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157093 A1
- Document ID: US20250157093A1
- Status: Published application
- Kind: A1
- Application number: 18/949,681
- Filed: 2024-11-15
- Published: 2025-05-15
- Earliest claimed: 2023-11-15
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Shlomo Fruchter; Omri Avrahami; Daniel Cohen-Or; Daniel Lischinski; Amir Hertz
- Web page: https://patentgrep.com/patent/US20250157093A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06N 20/00: Machine learning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Provided are systems and methods for generating self-consistent synthetic imagery based on a textual prompt. The proposed approaches address the challenge of producing consistent character images across different contexts, which is a common limitation of existing text-to-image generative models. The proposed approaches can be beneficial in various creative fields such as book illustration, brand crafting, comic creation, presentation development, and webpage design, where visual consistency is crucial.

## Claims

### Claim 1

A computer-implemented method to generate multiple, self-consistent synthetic images of a visual object, the method comprising:
obtaining, by a computing system, a textual prompt that textually describes the visual object;
for each of one or more update iterations:
processing, by the computing system, the textual prompt with a machine-learned image generation model to generate a plurality of synthetic images that depict the visual object; and
training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images; and
after a final update iteration of the one or more update iterations, processing, by the computing system, the textual prompt with the machine-learned image generation model to generate a plurality of output images that depict the visual object.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images comprises:
selecting, by the computing system, a subset of the plurality of synthetic images that exhibit visual cohesion; and
training, by the computing system, the machine-learned image generation model on the selected a subset of the plurality of synthetic images that exhibit visual cohesion.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein selecting, by the computing system, the subset of the plurality of synthetic images that exhibit visual cohesion comprises:
generating, by the computing system, a plurality of embeddings respectively for the plurality of synthetic images in a latent embedding space;
clustering, by the computing system, the plurality of embeddings into a plurality of clusters;
evaluating, by the computing system, a cohesion measure for each of the plurality of clusters to determine a plurality of cohesion values respectively for the plurality of clusters; and
selecting, by the computing system, one of the plurality of clusters as the subset of the plurality of synthetic images based on the plurality of cohesion values.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the cohesion measure evaluated for each cluster comprises an average Euclidean distance between members of the cluster and a centroid of the cluster.

### Claim 5 (depends on 3)

The computer-implemented method of claim 3, further comprising discarding, by the computing system, any cluster with a number of members below a threshold value.

### Claim 6 (depends on 3)

The computer-implemented method of claim 3, wherein clustering, by the computing system, the plurality of embeddings into the plurality of clusters comprises performing a K-MEANS++ algorithm.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images comprises performing a text-to-image personalization technique on at least some of the plurality of synthetic images.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images comprises performing textual inversion to learn a set of dedicated learnable textual tokens.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images comprises updating one or more parameters of the machine-learned image generation model.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein updating the one or more parameters of the machine-learned image generation model comprises learning a set of low-rank adaptation values.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more update iterations comprise a plurality of update iterations.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the method comprises performing update iterations until a model convergence metric is satisfied, wherein the model convergence metric comprises an average pairwise Euclidean distance between the synthetic images being smaller than a predefined threshold.

### Claim 13 (depends on 1)

The computer-implemented method of claim 1, wherein the visual object comprises a novel visual object not depicted in any training data on which the machine-learned image generation model has been trained.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, wherein the machine-learned image generation model comprises a pre-trained model.

### Claim 15 (depends on 1)

The computer-implemented method of claim 1, wherein the machine-learned image generation model comprises a denoising diffusion model.

### Claim 16

A computing system comprising one or more processors and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
obtaining, by the computing system, a textual prompt that textually describes the visual object;
for each of one or more update iterations:
processing, by the computing system, the textual prompt with a machine-learned image generation model to generate a plurality of synthetic images that depict the visual object; and
training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images; and
after a final update iteration of the one or more update iterations, processing, by the computing system, the textual prompt with the machine-learned image generation model to generate a plurality of output images that depict the visual object.

### Claim 17 (depends on 16)

The computing system of claim 16, wherein training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images comprises:
selecting, by the computing system, a subset of the plurality of synthetic images that exhibit visual cohesion; and
training, by the computing system, the machine-learned image generation model on the selected a subset of the plurality of synthetic images that exhibit visual cohesion.

### Claim 18 (depends on 17)

The computing system of claim 17, wherein selecting, by the computing system, the subset of the plurality of synthetic images that exhibit visual cohesion comprises:
generating, by the computing system, a plurality of embeddings respectively for the plurality of synthetic images in a latent embedding space;
clustering, by the computing system, the plurality of embeddings into a plurality of clusters;
evaluating, by the computing system, a cohesion measure for each of the plurality of clusters to determine a plurality of cohesion values respectively for the plurality of clusters; and
selecting, by the computing system, one of the plurality of clusters as the subset of the plurality of synthetic images based on the plurality of cohesion values.

### Claim 19 (depends on 18)

The computing system of claim 18, wherein the cohesion measure evaluated for each cluster comprises an average Euclidean distance between members of the cluster and a centroid of the cluster.

### Claim 20

A non-transitory computer-readable media storing a machine-learned image generation model configured to generate images via interaction with a computing system that performs operations, the operations comprising:
obtaining, by the computing system, a textual prompt that textually describes the visual object;
for each of one or more update iterations:
processing, by the computing system, the textual prompt with a machine-learned image generation model to generate a plurality of synthetic images that depict the visual object; and
training, by the computing system, the machine-learned image generation model on at least some of the plurality of synthetic images; and
after a final update iteration of the one or more update iterations, processing, by the computing system, the textual prompt with the machine-learned image generation model to generate a plurality of output images that depict the visual object.
