Method and electronic device for synthesizing video

An electronic device for synthesizing a video, the electronic device comprising:

• memory, comprising one or more storage media, storing instructions;
• and
• at least one processor communicatively coupled to the memory,
• wherein the instructions, when executed individually or collectively by the at least one processor, cause the electronic device to:
• obtain a shared motion latent code associated with a motion between frames of the video by inputting an input frame to a first encoder,
• obtain a first latent representation by inputting the input frame to a second encoder to reduce a resolution of the input frame, and
• predict, by using a trained neural network model, a next frame from the input frame based on the shared motion latent code and the first latent representation.

One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by individually or collectively by at least one processor of an electronic device cause the electronic device to perform operations, the operations comprising:

• obtaining a shared motion latent code corresponding to a motion between frames of a video by inputting an input frame to a first encoder;
• obtaining a first latent representation by inputting the input frame to a second encoder to reduce a resolution of the input frame;
• and
• predicting, by using a trained neural network model, a next frame from the input frame based on the shared motion latent code and the first latent representation.