Autoregressive content rendering for temporally coherent video generation

A system, comprising:

• a processor configured to execute operations including:
• generating, by an autoencoder network, a plurality of predicted images, wherein the plurality of predicted images are red, green, blue (RGB) images;
• feeding the plurality of predicted images back to the autoencoder network;
• encoding the plurality of predicted images to generate a plurality of encoded predicted images;
• and
• encoding a plurality of keypoint images to generate a plurality of encoded keypoint images;
• wherein one or more predicted images of the plurality of predicted images are generated by decoding a selected encoded keypoint image of the plurality of encoded keypoint images with an encoded predicted image of the plurality of encoded predicted images of a prior iteration of the autoencoder network.

A computer program product comprising one or more non-transitory computer readable storage mediums having an autoencoder network stored thereon, the autoencoder network comprising:

• a first encoder configured to encode a plurality of predicted images to generate a plurality of encoded predicted images, wherein the plurality of predicted images are red, green, blue (RGB) images;
• a second encoder configured to encode a plurality of keypoint images to generate a plurality of encoded keypoint images;
• and
• a decoder configured to generate the plurality of predicted images by iteratively decoding a selected encoded keypoint image of the plurality of encoded keypoint images with an encoded predicted image of the plurality of encoded predicted images of a prior iteration of the autoencoder network;
• wherein the plurality of predicted images are fed back to the autoencoder network to generate further predicted images.