Generative ai-based video aspect ratio enhancement

An electronic device comprising:

• at least one processing device configured to:
• obtain a video including multiple scenes at a first aspect ratio;
• perform backward optical flow estimation and forward optical flow estimation for each of the multiple scenes to select an image frame having a largest missing area;
• perform outpainting on the image frame having the largest missing area to generate a first outpainted image frame at a second aspect ratio different from the first aspect ratio;
• and
• perform backward optical flow estimation and forward optical flow estimation using the first outpainted image frame to generate additional outpainted image frames in the multiple scenes at the second aspect ratio.

A non-transitory machine-readable medium containing instructions that when executed cause at least one processor of an electronic device to:

• obtain a video including multiple scenes at a first aspect ratio;
• perform backward optical flow estimation and forward optical flow estimation for each of the multiple scenes to select an image frame having a largest missing area;
• perform outpainting on the image frame having the largest missing area to generate a first outpainted image frame at a second aspect ratio different from the first aspect ratio;
• and
• perform backward optical flow estimation and forward optical flow estimation using the first outpainted image frame to generate additional outpainted image frames in the multiple scenes at the second aspect ratio.