# US 2026/0065425 A1 · Generative object compositing by learning identity-preserving representation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065425 A1
- Document ID: US20260065425A1
- Status: Published application
- Kind: A1
- Application number: 18/821,013
- Filed: 2024-08-30
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Yizhi Song; Zhifei Zhang; Zhe Lin; Jianming Zhang; Scott Cohen; Brian Price; Soo Ye Kim; He Zhang; Wei Xiong
- Web page: https://patentgrep.com/patent/US20260065425A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/70: Denoising; Smoothing
- G06T 7/194: involving foreground-background segmentation
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method, apparatus, non-transitory computer readable medium, and system for image generation include obtaining a foreground image and a background image. The foreground image depicts an object and the background image depicts a scene. The foreground image is encoded, using an image encoder of an image generation model, to obtain a foreground embedding. The foreground embedding preserves the identity of the object. A composite image is generated, using the image generation model, based on the background image and the foreground embedding. The composite image depicts the object from the foreground image within the scene from the background image.

## Claims

### Claim 1

A method comprising:
obtaining a foreground image and a background image, wherein the foreground image depicts an object and the background image depicts a scene;
encoding, using an image encoder of an image generation model, the foreground image to obtain a foreground embedding, wherein the foreground embedding preserves an identity of the object; and
generating, using the image generation model, a composite image based on the background image and the foreground embedding, wherein the composite image depicts the object from the foreground image within the scene from the background image.

### Claim 2 (depends on 1)

The method of claim 1, wherein obtaining the foreground image comprises:
obtaining a preliminary image; and
removing a background from the preliminary image to obtain the foreground image.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the background image comprises a masked region indicating a location and a scale for the object.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating the composite image comprises:
obtaining an input mask indicating a location of the object in the scene, wherein the composite image is generated based on the input mask.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the composite image comprises:
obtaining a noise map; and
denoising the noise map based on the foreground embedding.

### Claim 6 (depends on 5)

The method of claim 5, wherein:
the noise map is generated based on the background image.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
the image encoder is trained to preserve an object identity during a first training stage and wherein the image encoder and a decoder of the image generation model are trained to combine images during a second training stage.

### Claim 8

A method of training an image generation model, the method comprising:
obtaining a first training set including a first training image and a second training image, wherein the second training image depicts an object from the first training image in a different view;
training, using the first training set during a first training stage, an image generation model to generate a synthetic image that preserves an identity and changes an orientation of an object from an input image;
obtaining a second training set including a training foreground image, a training background image, and a ground-truth composite image that depicts an object from the training foreground image in a scene from the training background image; and
training, using the second training set during a second training stage, the image generation model to generate a composite image based on an input foreground image and an input background image, wherein the composite image depicts an object from the input foreground image in a scene from the input background image.

### Claim 9 (depends on 8)

The method of claim 8, wherein training the image generation model during the first training stage comprises:
generating a preliminary output based on the first training image;
computing an identity preserving loss based on the preliminary output and the second training image; and
updating parameters of the image generation model based on the identity preserving loss.

### Claim 10 (depends on 8)

The method of claim 8, wherein training the image generation model during the first training stage comprises:
initializing the image generation model using parameters of a pre-trained base model; and
freezing an encoder layer of the image generation model during the first training stage.

### Claim 11 (depends on 10)

The method of claim 10, wherein training the image generation model during the second training stage comprises:
training the encoder layer of the image generation model during the second training stage.

### Claim 12 (depends on 8)

The method of claim 8, wherein training the image generation model during the second training stage comprises:
generating a preliminary composite output based on the training foreground image and the training background image;
computing a compositing loss based on the preliminary composite output and the ground-truth composite image; and
updating parameters of the image generation model based on the compositing loss.

### Claim 13 (depends on 8)

The method of claim 8, wherein training the image generation model during the second training stage comprises:
freezing an image encoder of the image generation model during the second training stage.

### Claim 14 (depends on 13)

The method of claim 13, wherein training the image generation model during the first training stage comprises:
training the image encoder of the image generation model during the first training stage.

### Claim 15 (depends on 8)

The method of claim 8, wherein obtaining the second training set comprises:
obtaining a video; and
extracting the first training image from a first frame of the video and the second training image from a second frame of the video.

### Claim 16 (depends on 8)

The method of claim 8, wherein obtaining the second training set comprises:
obtaining a preliminary image; and
applying a transformation or a perturbation to the preliminary image to obtain the training foreground image.

### Claim 17

An apparatus comprising:
at least one processor;
at least one memory including instructions executable by the at least one processor; and
an image generation model comprising parameters stored in the at least one memory and trained to encode a foreground image to obtain a foreground embedding that preserves an identity of an object in the foreground image and generate a composite image based on a background image and the foreground embedding, wherein the composite image depicts the object from the foreground image within a scene from the background image.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein:
the image generation model comprises an image encoder that encodes the foreground image and an image generator that generates the composite image.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein:
the image encoder comprises a base encoder and a content adapter.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein:
the image generation model comprises a diffusion U-Net.
