Image generation method and related device

An image generation apparatus, deployed on an electronic device, and comprising:

• at least one memory configured to store program code;
• and
• at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
• obtaining code configured to cause the at least one processor to obtain an original face image frame, audio driving information, and emotion driving information of a to-be-adjusted object, the original face image frame comprising an original face of the to-be-adjusted object, the audio driving information comprising voice content of the to-be-adjusted object, to drive a face pose of the original face to change according to the voice content, and in a case of issuing the voice content, the emotion driving information being configured for describing a target emotion of the to-be-adjusted object to drive the face pose of the original face to change according to the target emotion;
• extraction code configured to cause the at least one processor to perform spatial feature extraction on the original face image frame, to obtain an original face spatial feature corresponding to the original face image frame;
• interaction code configured to cause the at least one processor to perform feature interaction processing on the audio driving information and the emotion driving information, to obtain a face local pose feature of the to-be-adjusted object issuing the voice content with the target emotion;
• and
• reconstruction code configured to cause the at least one processor to perform, based on the original face spatial feature and the face local pose feature, face reconstruction processing on the to-be-adjusted object, to generate a target face image frame.

A non-transitory computer-readable storage medium having an instructions stored therein, which when executed by a processor in an electronic device cause the processor to execute an image generation method comprising:

• obtaining an original face image frame, audio driving information, and emotion driving information, the original face image frame comprising an original face of a to-be-adjusted object, the audio driving information comprising voice content of the to-be-adjusted object to drive a face pose of the original face to change according to the voice content, and in a case of issuing the voice content, the emotion driving information being configured for describing a target emotion of the to-be-adjusted object to drive the face pose of the original face to change according to the target emotion;
• performing spatial feature extraction on the original face image frame to obtain an original face spatial feature corresponding to the original face image frame;
• performing feature interaction processing on the audio driving information and the emotion driving information to obtain a face local pose feature of the to-be-adjusted object issuing the voice content with the target emotion;
• and
• performing, based on the original face spatial feature and the face local pose feature, face reconstruction processing on the to-be-adjusted object to generate a target face image frame.