Utilizing generative models for resynthesis of transition frames in clipped digital videos

A system comprising:

• one or more memory components;
• and
• one or more processing devices coupled to the one or more memory components, the one or more processing devices to perform operations comprising:
• receiving a clipped digital video comprising a pre-cut frame prior to a gap in the clipped digital video and a post-cut frame following the gap in the clipped digital video;
• generating, a pre-cut keypoint map from the pre-cut frame and a post-cut keypoint map from the post-cut frame;
• generating a sequence of transition keypoint maps for the gap in the clipped digital video from the pre-cut keypoint map and the post-cut keypoint map;
• and
• generating, utilizing a generative neural network, a sequence of transition frames for the clipped digital video from the sequence of transition keypoint maps, a source frame of the clipped digital video, and a keypoint map corresponding to the source frame.

A non-transitory computer-readable medium storing executable instructions which, when executed by at least one processing device, cause the at least one processing device to perform operations comprising:

• receiving a clipped digital video comprising a pre-cut frame prior to a gap in the clipped digital video and a post-cut frame following the gap in the clipped digital video;
• generating a sequence of transition keypoint maps utilizing the pre-cut frame and the post-cut frame;
• and
• generating, utilizing a generative neural network, a sequence of transition frames for the gap in the clipped digital video from the sequence of transition keypoint maps.