US 2009/0213234 A1Published application

Method of full frame video stabilization

AssigneeNational Taiwan University

InventorsBing-Yu Chen, Wei-Ting Huang, Jong-Shan Lin

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method of full-frame video stabilization with a polyline-fitted camcorder path is disclosed. The regions was first considered of interest in the video to estimate which regions or objects the user wants to capture, and then use a polyline to estimate a new stable camcorder motion path while avoiding the user's interested regions or objects being cut out. Then, the dynamic and static missing areas caused by frame alignment from other frames were filled to keep the same resolution and quality as the original video. Furthermore, the discontinuous regions were smoothed by using a three-dimensional Poisson-based method. After the above automatic operations, a full-frame stabilized video could be achieved and the important regions and objects could also be preserved.

Claims17

Dependent claims

A method of full frame video stabilization with polyline-fitted camcorder path, comprising the steps:

a) making motion path estimation, further including steps:
i) combining all transformations between consecutive frames to obtain a global motion path of the original video;
ii) approximating the global motion path with polyline;
iii) changing position of each frame in accordance with frame alignment along new motion path;
b) making video completion, further including steps:
i) detecting and locating existing moving objects
ii) separating the moving objects as dynamic foreground regions from static background regions and completing the missing areas;
iii) filling the missing areas with pixels on the frames far from the current frame;
iv) smoothing discontinuous regions by applying a three-dimensional Poisson-based approach;
and
c) deblurring image of frames by transferring the pixel values from neighboring sharper frames to the blurry frames.

8 more elements

Dependencies are inferred from the claim text.