Method and system for optimizing optical flow for images based on residual field and displacement field

A system for optimizing optical flow for images based on a residual field and a displacement field, comprising:

• a reference image obtaining module, configured to obtain reference images, the reference images are two adjacent images in an image sequence;
• an optical flow estimation module, configured to estimate an initial optical flow field from the reference images by using an optical flow estimation method;
• an optical flow optimization model obtaining module, configured to obtain the optical flow optimization model, wherein the optical flow optimization model comprises an image encoder, an optical flow encoder, a first decoder, and a sub-decoder;
• a residual field and displacement field calculation module, configured to input any image of the reference images and the initial optical flow field into the optical flow optimization model to output the residual field and the displacement field;
• a superposition module, configured to superimpose the initial optical flow field and the residual field to obtain a preliminarily optimized optical flow field;
• and
• a resampling module, configured to resample the preliminarily optimized optical flow field by using the displacement field to obtain an optimized optical flow field.