Photorealistic real-time portrait animation

A computing device comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the computing device to:
• receive a scenario video, the scenario video including at least one input frame, the at least one input frame including a first face;
• receive a target image, the target image including a second face;
• determine, based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face in the target image, wherein the 2D deformations when applied to the second face, modify the second face to imitate at least a facial expression of the first face;
• and
• apply the 2D deformations to the target image to obtain at least one output frame of an output video.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computing device, cause the computing device to:

• receive a scenario video, the scenario video including at least one input frame, the at least one input frame including a first face;
• receive a target image, the target image including a second face;
• determine based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face in the target image, wherein the 2D deformations when applied to the second face, modify the second face to imitate at least a facial expression of the first face;
• and
• apply the 2D deformations to the target image to obtain at least one output frame of an output video.