Method and apparatus for generating video intermediate frame

An apparatus for generating a video intermediate frame, comprising:

• at least one processor;
• and
• a memory configured to store instructions which, when executed by the at least one processor, cause the at least one processor to:
• obtain a target video frame pair;
• construct an image pyramid for each video frame in the target video frame pair;
• and
• generate an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on pyramid,
• wherein the at least one processor configured, when generating the intermediate frame of the target video frame pair, to:
• repairing a bidirectional optical flow corresponding to a previous layer by using the bidirectional optical flow estimation model, and
• repairing a previous intermediate frame corresponding to the previous layer by using the pixel synthesis model.

A non-transitory computer-readable storage medium storing computer-readable instructions, which, when executed by at least one processor, cause the at least one processor to:

• obtain a target video frame pair;
• construct an image pyramid for each video frame in the target video frame pair;
• and
• generate an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid,
• wherein the at least one processor configured, when generating the intermediate frame of the target video frame pair, to:
• repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model based on an image of a current layer, and
• repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.