# US 2026/0093978 A1 · Model training method, image editing method, apparatus, device, medium, and product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093978 A1
- Document ID: US20260093978A1
- Status: Published application
- Kind: A1
- Application number: 19/314,144
- Filed: 2025-08-29
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Beijing Zitiao Network Technology Co., Ltd.; Lemon Inc.
- Applicants: Beijing Zitiao Network Technology Co., Ltd.; Lemon Inc.
- Inventors: Xin GU; Sijie ZHU; Fan CHEN; Longyin WEN
- Web page: https://patentgrep.com/patent/US20260093978A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/045: Combinations of networks
- G06N 3/08: Learning methods
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

The present application discloses a model training method, an image editing method, an apparatus, a device, a medium, and a product. The method includes: first acquiring an original image, an editing description text corresponding to the original image, an edited image corresponding to the original image with respect to the editing description text, and evaluation information of the edited image, enabling the evaluation information to describe the state of the edited image in at least one evaluation item. Then the original image, the editing description text and the evaluation information by using an image editing model are processed to obtain an image editing result corresponding to the original image. According to the difference between the image editing result and the edited image, the image editing model is updated.

## Claims

### Claim 1

A model training method, comprising:
acquiring an original image, an editing description text corresponding to the original image, an edited image corresponding to the original image with respect to the editing description text, and evaluation information of the edited image, wherein the evaluation information is configured to describe a state of the edited image with respect to at least one evaluation item;
processing the original image, the editing description text and the evaluation information by using an image editing model to obtain an image editing result corresponding to the original image; and
updating the image editing model according to a difference between the image editing result and the edited image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one evaluation item comprises one or more of: a text following evaluation item, an image preserving evaluation item, and an image quality evaluation item;
the text following evaluation item is configured to describe a matching state presented between the edited image and the edit description text with respect to first content, wherein the first content is determined in accordance with at least one edit instruction described by the edit description text;
the image preserving evaluation item is configured to describe a matching state presented between the edited image and the original image with respect to second content, wherein the second content is determined based on content in the original image other than the first content; and
the image quality evaluation item is configured to describe a quality change of the edited image relative to the original image.

### Claim 3 (depends on 1)

The method of claim 1, wherein the evaluation information comprises a score of each of the evaluation items, and/or the evaluation information comprises a defect description text of some or all of the evaluation items;
for one of the evaluation items, the score of the evaluation item is configured to characterize a level achieved by the edited image with respect to the one evaluation item, and the defect description text of the one evaluation item is configured to describe the defect of the edited image with respect to the evaluation item.

### Claim 4 (depends on 3)

The method of claim 3, wherein the at least one evaluation item comprises one or more of: a text following evaluation item, an image preserving evaluation item, or an image quality evaluation item;
a score of the text following evaluation item is configured to describe a similarity degree between a change in content of the edited image relative to the original image and a change in content described by the edited description text;
a score of the image preserving evaluation item is configured to describe a similarity degree between content retained by the edited image relative to the original image and content in the original image other than the edited content specified by the editing description text;
a score of the image quality evaluation term is configured to describe a quality change of the edited image relative to the original image;
a defect description text of the text following evaluation item is configured to describe at least one following error of the edited image relative to the edited description text;
a defect description text of the image preserving evaluation item is configured to describe at least one preserving error of the edited image relative to the original image; and
a defect description text of the image quality evaluation item is configured to describe at least one quality defect of the edited image relative to the original image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the evaluation information is introduced as condition information into a de-noising network in the image editing model.

### Claim 6 (depends on 5)

The method of claim 5, wherein for one of the cross-attention layers in the de-noising network, input data of a data fusion layer corresponding to the one cross-attention layer is determined based on the evaluation information and output data of the one cross-attention layer, and the input data of the one cross-attention layer comprises an encoding result of the editing description text.

### Claim 7 (depends on 6)

The method of claim 6, wherein the input data of the data fusion layer is determined based on a feature vector of the evaluation information;
the evaluation information comprises at least one type of data, and the feature vector of the evaluation information is determined according to a vectorization result of each type of data and a vectorization result of each type.

### Claim 8 (depends on 6)

The method of claim 6, wherein the data fusion layer is configured to perform residual error calculation or sum value calculation according to the output data of the cross-attention layer and a mapping result of a feature vector of the evaluation information in a first feature space, and the first feature space is a feature space to which the output data of the cross-attention layer belongs.

### Claim 9 (depends on 1)

The method of claim 1, wherein input data of a de-noising network in the image editing model comprises first data and second data, the first data is input to the de-noising network as condition information, input data of a first network layer in the de-noising network comprises the second data, the first data is different from the second data;
the second data is determined based on the original image and the evaluation information.

### Claim 10 (depends on 9)

The method of claim 9, wherein a determination process of the second data comprises:
performing concatenating processing on the image feature of the original image and the noise addition result of the image feature of the edited image to obtain a concatenating result;
performing convolution processing on the concatenating result to obtain a convolution result; and
performing at least one cross-attention processing according to the convolution result and a mapping result of a feature vector of the evaluation information in a second feature space to obtain the second data, wherein the second feature space is a feature space to which the convolution result belongs.

### Claim 11 (depends on 1)

The method of claim 1, wherein the image editing model comprises a first module, a second module, a third module, a linear layer corresponding to the third module, a de-noising network, a linear layer corresponding to the de-noising network, and a decoding module;
the first module is configured to obtain a concatenating result between an image feature of the original image and a noise addition result of an image feature of the edited image;
the second module is configured to acquire a feature vector of the evaluation information;
the linear layer corresponding to the third module and the linear layer corresponding to the de-noising network are configured to process the feature vector of the evaluation information;
the third module is configured to perform at least one cross-attention processing according to the concatenating result and the output data of the linear layer corresponding to the third module;
the de-noising network is configured to perform de-noising processing according to the output data of the third module, the encoding result of the editing description text, and the output data of the linear layer corresponding to the de-noising network; and
the decoding module is configured to perform decoding processing on the output data of the de-noising network to obtain the image editing result.

### Claim 12 (depends on 11)

The method of claim 11, wherein updating the image editing model comprises:
updating a part of modules in the image editing model, wherein the part of modules comprises some or all network layers in the second module, the third module, the linear layer corresponding to the third module, the de-noising network, and the linear layer corresponding to the de-noising network.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
acquiring a target image, an edit description text corresponding to the target image, and preset constraint information; and
processing the target image, the editing description text, and the preset constraint information by using the image editing model to obtain an image editing result corresponding to the target image, wherein the preset constraint information is configured to describe a state of the image editing result with respect to at least one evaluation item.

### Claim 14

An electronic device comprising: a processor and a memory;
wherein the memory is configured to store instructions or a computer program; and
the processor is configured to execute the instructions or the computer program in the memory to cause the electronic device to:
acquire an original image, an editing description text corresponding to the original image, an edited image corresponding to the original image with respect to the editing description text, and evaluation information of the edited image, wherein the evaluation information is configured to describe a state of the edited image with respect to at least one evaluation item;
process the original image, the editing description text and the evaluation information by using an image editing model to obtain an image editing result corresponding to the original image; and
update the image editing model according to a difference between the image editing result and the edited image.

### Claim 15 (depends on 14)

The electronic device of claim 14, wherein the at least one evaluation item comprises one or more of: a text following evaluation item, an image preserving evaluation item, and an image quality evaluation item;
the text following evaluation item is configured to describe a matching state presented between the edited image and the edit description text with respect to first content, wherein the first content is determined in accordance with at least one edit instruction described by the edit description text;
the image preserving evaluation item is configured to describe a matching state presented between the edited image and the original image with respect to second content, wherein the second content is determined based on content in the original image other than the first content; and
the image quality evaluation item is configured to describe a quality change of the edited image relative to the original image.

### Claim 16 (depends on 14)

The electronic device of claim 14, wherein the evaluation information comprises a score of each of the evaluation items, and/or the evaluation information comprises a defect description text of some or all of the evaluation items;
for one of the evaluation items, the score of the evaluation item is configured to characterize a level achieved by the edited image with respect to the one evaluation item, and the defect description text of the one evaluation item is configured to describe the defect of the edited image with respect to the evaluation item.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the at least one evaluation item comprises one or more of: a text following evaluation item, an image preserving evaluation item, or an image quality evaluation item;
a score of the text following evaluation item is configured to describe a similarity degree between a change in content of the edited image relative to the original image and a change in content described by the edited description text;
a score of the image preserving evaluation item is configured to describe a similarity degree between content retained by the edited image relative to the original image and content in the original image other than the edited content specified by the editing description text;
a score of the image quality evaluation term is configured to describe a quality change of the edited image relative to the original image;
a defect description text of the text following evaluation item is configured to describe at least one following error of the edited image relative to the edited description text;
a defect description text of the image preserving evaluation item is configured to describe at least one preserving error of the edited image relative to the original image; and
a defect description text of the image quality evaluation item is configured to describe at least one quality defect of the edited image relative to the original image.

### Claim 18 (depends on 14)

The electronic device of claim 14, wherein the evaluation information is introduced as condition information into a de-noising network in the image editing model.

### Claim 19 (depends on 18)

The electronic device of claim 18, wherein for one of the cross-attention layers in the de-noising network, input data of a data fusion layer corresponding to the one cross-attention layer is determined based on the evaluation information and output data of the one cross-attention layer, and the input data of the one cross-attention layer comprises an encoding result of the editing description text.

### Claim 20

A non-transitory computer-readable medium having instructions or computer programs stored therein that, when executed on a device, cause the device to:
acquire an original image, an editing description text corresponding to the original image, an edited image corresponding to the original image with respect to the editing description text, and evaluation information of the edited image, wherein the evaluation information is configured to describe a state of the edited image with respect to at least one evaluation item;
process the original image, the editing description text and the evaluation information by using an image editing model to obtain an image editing result corresponding to the original image; and
update the image editing model according to a difference between the image editing result and the edited image.
