Video frame synthesis using tensor neural networks

A computer readable storage medium comprising a computer readable program for implementing video frame synthesis using a tensor neural network, wherein the computer readable program when executed on a computer causes the computer to perform a method including:

• receiving input video data including one or more missing frames;
• converting the input video data into an input tensor;
• generating, through tensor completion based on the input tensor, output video data including one or more synthesized frames corresponding to the one or more missing frames by using a transform-based tensor neural network (TTNet) including a plurality of phases implementing a tensor iterative shrinkage thresholding algorithm (ISTA);
• and
• obtaining a loss function based on the output video data.

A system for implementing video frame synthesis using a tensor neural network, comprising:

• a memory configured to store program code;
• and
• at least one processor device operatively coupled to the memory and configured to execute program code stored on the memory to:
• receive input video data including one or more missing frames;
• convert the input video data into an input tensor;
• generate, through tensor completion based on the input tensor, output video data including one or more synthesized frames corresponding to the one or more missing frames by using a transform-based tensor neural network (TTNet) including a plurality of phases implementing a tensor iterative shrinkage thresholding algorithm (ISTA);
• and
• obtain a loss function based on the output video data.