Face-aware offset calculation module and method for facial frame interpolation and enhancement and a face video deblurring system and method using the same

A non-transitory computer-readable medium containing program instructions, which comprises a Face-aware Offset Calculation (FOC) module, executed by a processor or controller, the FOC module of the program instructions when executed by the processor or controller configured to:

• receive feature maps and landmark heatmaps of a set of frames;
• perform a vector concatenation of the feature maps and the landmark heatmaps together to generate inputs, wherein the vector concatenation Joins the feature maps and the landmark heatmaps end-to-end by concatenating a vector of the feature maps and a vector of the landmark heatmaps together end-to-end to form a concatenated new vector including elements of the vector of the feature maps and the vector of the landmark heatmaps;
• and generate an offset map by performing a regression analysis on the inputs, wherein the offset map represents a map of 2D offset vectors that indicate magnitudes by which convolution kernel's sampling locations are to be deformed at each pixel to transform a feature from one frame to another in a deformable convolution network (DCN), and wherein the offset map is configured to be used by the DCN to align and/or interpolate a facial feature map.