Method for video frame interpolation, and electronic device
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorChao Li
Life of this patent
Estimating the term…
Abstract
The disclosure discloses a method for video frame interpolation. The method includes: obtaining a first visual semantic feature and first pixel information of a first frame, and obtaining a second visual semantic feature and second pixel information of a second frame; generating semantic optical flow information based on the first visual semantic feature and the second visual semantic feature; generating pixel optical flow information based on the first pixel information and the second pixel information; and generating an interpolation frame between the first frame and the second frame based on the semantic optical flow information and the pixel optical flow information, and interpolating the interpolation frame between the first frame and the second frame.
Claims20
A method for video frame interpolation, comprising:
- obtaining a first visual semantic feature and first pixel information of a first frame, and obtaining a second visual semantic feature and second pixel information of a second frame, wherein the first frame and the second frame are adjacent frames in a video;
- generating semantic optical flow information based on the first visual semantic feature and the second visual semantic feature;
- generating pixel optical flow information based on the first pixel information and the second pixel information;
- and
- generating an interpolation frame between the first frame and the second frame based on the semantic optical flow information and the pixel optical flow information, and interpolating the interpolation frame between the first frame and the second frame.
An electronic device, comprising:
- at least one processor;
- and
- a memory, communicatively coupled to the at least one processor,
- wherein the memory is configured to store instructions executable by the at least one processor, and the at least one processor is caused to execute a method for video frame interpolation when the instructions are executed by the at least one processor, the method comprising:
- obtaining a first visual semantic feature and first pixel information of a first frame, and obtaining a second visual semantic feature and second pixel information of a second frame, wherein the first frame and the second frame are adjacent frames in a video;
- generating semantic optical flow information based on the first visual semantic feature and the second visual semantic feature;
- generating pixel optical flow information based on the first pixel information and the second pixel information;
- and
- generating an interpolation frame between the first frame and the second frame based on the semantic optical flow information and the pixel optical flow information, and interpolating the interpolation frame between the first frame and the second frame.
A non-transitory computer readable storage medium having computer instructions stored thereon, wherein the computer instructions are configured to cause a computer to execute a method for video frame interpolation, the method comprising:
- obtaining a first visual semantic feature and first pixel information of a first frame, and obtaining a second visual semantic feature and second pixel information of a second frame, wherein the first frame and the second frame are adjacent frames in a video;
- generating semantic optical flow information based on the first visual semantic feature and the second visual semantic feature;
- generating pixel optical flow information based on the first pixel information and the second pixel information;
- and
- generating an interpolation frame between the first frame and the second frame based on the semantic optical flow information and the pixel optical flow information, and interpolating the interpolation frame between the first frame and the second frame.
Dependencies are inferred from the claim text.