# US 2025/0166264 A1 · Diffusion model multi-person image generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166264 A1
- Document ID: US20250166264A1
- Status: Published application
- Kind: A1
- Application number: 18/947,989
- Filed: 2024-11-14
- Published: 2025-05-22
- Earliest claimed: 2023-11-17
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Aleksandr Belskikh; Igor Filippov; Roman Golobokov; Elena Koritskaya; Leonid Kulikov; Anton Pankratov; Nikolai Smirnov
- Web page: https://patentgrep.com/patent/US20250166264A1

## CPC

- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 7/194: involving foreground-background segmentation
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 2207/20081: Training; Learning
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods and systems are disclosed for generating personalized images using one or more diffusion models. The methods and systems access first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person. The methods and systems generate a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image. The methods and systems access generate a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.

## Claims

### Claim 1

A method comprising:
accessing first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person;
generating a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image;
accessing background information; and
generating a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
accessing a prompt comprising the background information; and
processing the foreground image and the prompt by a third generative machine learning model to generate the new artificial image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the prompt comprises an image depicting the background information.

### Claim 4 (depends on 2)

The method of claim 2, wherein the prompt comprises a textual description of the background information.

### Claim 5 (depends on 2)

The method of claim 2, wherein the first generative machine learning model, the second generative machine learning model, and the third generative machine learning model each comprises a respective diffusion machine learning model.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first and second generative machine learning models each comprises a respective diffusion machine learning model.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
obtaining foreground and background masks for each of the first and second artificial personalized images;
blending depictions of foregrounds from the first and second artificial personalized images using the foreground masks; and
inpainting a background of the blended depictions of the foregrounds from the first and second artificial personalized images using the background masks.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
generating a first segmentation of the first person depicted in the first artificial personalized image.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
extracting a first region of the first artificial personalized image based on the first segmentation, the first region comprising pixels that fall within the first segmentation;
extracting a second region of the second artificial personalized image based on the first segmentation, the second region of the second artificial personalized image excluding pixels that fall within the first segmentation; and
generating the foreground image by combining the first region and the second region.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
generating a second segmentation of the second person depicted in the second artificial personalized image; and
combining the first and second segmentations to generate a combined segmentation.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
inpainting the background on the foreground image based on the combined segmentation to generate the new artificial image.

### Claim 12 (depends on 11)

The method of claim 11, wherein the background is generated based on a prompt.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
receiving a first pose image comprising a depiction of an object in an individual pose;
receiving a first prompt that defines a first set of visual attributes; and
processing the first pose image and the first prompt by the first generative machine learning model to generate the first artificial personalized image.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
receiving a second pose image comprising a depiction of another object in another pose;
receiving a second prompt that defines a second set of visual attributes; and
processing the second pose image and the second prompt by the second generative machine learning model to generate the second artificial personalized image.

### Claim 15 (depends on 1)

The method of claim 1, further comprising training the first generative machine learning model by performing a first set of training operations comprising:
accessing a first set of training images that each depict the first person with a different background and in different poses;
receiving an image comprising a depiction of the first person;
receiving a prompt that defines visual attributes of an individual background depicted in an individual training image of the first set of training images and that defines a target pose depicted in the individual training image;
processing the image and the prompt by the first generative machine learning model to generate an estimated artificial image that depicts the first person in the target pose and an artificial background having the visual attributes defined by the prompt;
computing a deviation between the estimated artificial image and the individual training image; and
updating one or more parameters of the first generative machine learning model based on the deviation.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
capturing a plurality of images of the first person;
extracting a plurality of regions of the plurality of images that depicts the first person;
obtaining a set of prompts that define different visual attributes of backgrounds; and
processing the plurality of regions and the set of prompts by a diffusion model to generate the first set of training images.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
zooming in on the first person in the plurality of images to extract the plurality of regions.

### Claim 18 (depends on 15)

The method of claim 15, further comprising training the second generative machine learning model by performing a second set of training operations comprising:
accessing a second set of training images that each depict the second person with a different background and in different poses;
receiving a second image comprising a depiction of the second person;
receiving a second prompt that defines visual attributes of a second individual background depicted in a second individual training image of the second set of training images and that defines a second target pose depicted in the second individual training image;
processing the second image and the second prompt by the second generative machine learning model to generate a second estimated artificial image that depicts the second person in the second target pose and a second artificial background having the visual attributes defined by the second prompt;
computing a second deviation between the second estimated artificial image and the second individual training image; and
updating one or more parameters of the second generative machine learning model based on the second deviation.

### Claim 19

A system comprising:
at least one processor; and
at least one memory component having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
accessing first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person;
generating a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image;
accessing background information; and
generating a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.

### Claim 20

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
accessing first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person;
generating a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image;
accessing background information; and
generating a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.
