Video synthesis method, model training method, device, and storage medium

A computing device, comprising:

• one or more processors;
• and
• memory, the memory storing one or more programs comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• obtaining a plurality of frames corresponding to source image information of a first to-be-synthesized video, each frame of the source image information comprising a source image that includes a transfer object and a source motion key point having a one-to-one correspondence with the source image;
• obtaining a plurality of frames corresponding to target image information of a second to-be-synthesized video, the second to-be-synthesized video having a motion reference sequence for indicating an image order of video synthesis, each frame of the target image information comprising a target motion key point;
• for each frame of the plurality of frames corresponding to the target image information of the second to-be-synthesized video:
• fusing a respective source image from the first to-be-synthesized video, the corresponding source motion key point, and a respective target motion key point corresponding to the frame using a pre-trained video synthesis model;
• and
• generating a respective output image in accordance with the fusing, the respective output image comprising the transfer object modified by the respective target motion key point and corresponding to a respective frame of the plurality of frames of the source image information and the respective target motion key point;
• and
• repeating the fusing and the generating steps for the second to-be-synthesized video to produce a synthesized video according to the motion reference sequence.

A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a computing device, cause the one or more processors to perform operations comprising:

• obtaining a plurality of frames corresponding to source image information of a first to-be-synthesized video, each frame of the source image information comprising a source image that includes a transfer object and a source motion key point having a one-to-one correspondence with the source image;
• obtaining a plurality of frames corresponding to target image information of a second to-be-synthesized video, the second to-be-synthesized video having a motion reference sequence for indicating an image order of video synthesis, each frame of the target image information comprising a target motion key point;
• for each frame of the plurality of frames corresponding to the target image information of the second to-be-synthesized video:
• fusing a respective source image from the first to-be-synthesized video, the corresponding source motion key point, and a respective target motion key point corresponding to the frame using a pre-trained video synthesis model;
• and
• generating a respective output image in accordance with the fusing, the respective output image comprising the transfer object modified by the respective target motion key point and corresponding to a respective frame of the plurality of frames of the source image information and the respective target motion key point;
• and
• repeating the fusing and the generating steps for the second to-be-synthesized video to produce a synthesized video according to the motion reference sequence.