Image processing system with optical flow recovery mechanism and method of operation thereof

A method of operation of an image processing system comprising:

• detecting edges in a first image frame and a second image frame stored by a storage device or a memory;
• generating edge motion vectors between the first image frame and the second image frame based on the edges;
• extracting dominant motion vectors from a group of the edge motion vectors;
• generating a motion vector list based on the dominant motion vectors;
• generating a segmentation to generate image segments in the first image frame;
• generating initial motion vectors based on the segmentation and the motion vector list;
• generating smooth motion vectors based on the initial motion vectors;
• and
• generating a dense optical flow field by combining the smooth motion vectors.

An image processing system comprising:

• an edge motion generation unit for detecting edges in a first image frame and a second image frame stored by a storage device or a memory and for generating edge motion vectors between the first image frame and the second image frame based on the edges;
• a motion vector list generation unit for extracting dominant motion vectors from a group of the edge motion vectors and for generating a motion vector list based on the dominant motion vectors;
• an image segmentation unit for generating a segmentation of the first image frame;
• an initial motion generation unit for generating initial motion vectors based on the segmentation and the motion vector list;
• and
• a smooth motion generation unit for generating smooth motion vectors based on the initial motion vectors and for generating a dense optical flow field by combining the smooth motion vectors.