Method of Video Processing for Calibrating Motion Vectors

A video processing system, comprising:

• a processor configured to process a video;
• and
• a memory coupled to the processor, configured to store the video;
• wherein the processor divides a current frame of the video into a plurality of blocks, generates a motion vector (MV) of each block of the plurality of blocks of the current frame according to the each block of the current frame and a corresponding block of a previous frame, generates a global motion vector (GMV) according to a plurality of motion vectors of the current frame, generates a sum of absolute differences (SAD) of pixels of each block of the current frame according to the global motion vector, generates a region comprising a set of blocks of the current frame, matching a distribution of the sum of absolute differences of pixels of the region with a plurality of models, identifies a best matching model that best matches the distribution of the sum of absolute differences of the pixels of the region, and labels each block in the region in the current frame with a label of either a foreground block or a background block according to the best matching model.