Local attribute image editing using an image generation model and a feature image generation model

An image editing apparatus, the apparatus comprising:

• processing circuitry configured to
• acquire an initial image generation model and a feature image generation model, the initial image generation model having been trained based on a first training image set, the feature image generation model having been obtained by training the initial image generation model based on a second training image set, object images in the first training image set and the second training image set including objects of a same category, each object image in the second training image set comprising a target attribute, and an image output by the feature image generation model having the target attribute;
• based on an image editing request, input a value of a first variable as input data into the initial image generation model and the feature image generation model separately;
• in response to the input data, acquire an image output by the initial image generation model to obtain a first initial object image of the category, and acquire an image output by the feature image generation model to obtain a first feature object image of the category;
• based on image regions corresponding to the target attribute in the object images, acquire attribute mask images respectively corresponding to the first initial object image and the first feature object image, and obtain a joint mask image based on the attribute mask images;
• acquire images output by corresponding target network layers in the initial image generation model and the feature image generation model to obtain a second initial object image and a second feature object image;
• and
• fuse the second initial object image and the second feature object image based on the joint mask image to obtain a reference object image, as a result of performing target attribute editing on the second initial object image.

A non-transitory computer-readable storage medium storing computer-readable instructions thereon, which, when executed by processing circuitry, cause the processing circuitry to perform an image editing method comprising:

• acquiring an initial image generation model and a feature image generation model, the initial image generation model having been trained based on a first training image set, the feature image generation model having been obtained by training the initial image generation model based on a second training image set, object images in the first training image set and the second training image set including objects of a same category, each object image in the second training image set comprising a target attribute, and an image output by the feature image generation model having the target attribute;
• based on an image editing request, inputting a value of a first variable as input data into the initial image generation model and the feature image generation model separately;
• in response to the input data, acquiring an image output by the initial image generation model to obtain a first initial object image of the category, and acquiring an image output by the feature image generation model to obtain a first feature object image of the category;
• based on image regions corresponding to the target attribute in the object images, acquiring attribute mask images respectively corresponding to the first initial object image and the first feature object image, and obtaining a joint mask image based on the attribute mask images;
• acquiring images output by corresponding target network layers in the initial image generation model and the feature image generation model to obtain a second initial object image and a second feature object image;
• and
• fusing the second initial object image and the second feature object image based on the joint mask image to obtain a reference object image, as a result of performing target attribute editing on the second initial object image.