Low-light video processing method, device and storage medium

A low-illuminance video processing device, comprising:

• a memory;
• a processor;
• a program stored in the memory and executable by the processor;
• and
• a data bus, configured for communicative connection between the processor and the memory, wherein the program, when executed by the processor, causes the processor to carry out a low-illuminance video processing method comprising:
• acquiring a same number of preceding frame images and subsequent frame images corresponding to a current video frame of a low-illuminance video to obtain a frame image set corresponding to the current video frame, and performing traversal on the low-illuminance video to obtain frame image sets corresponding to all video frames;
• after performing image alignment on all frame images in the frame image sets corresponding to all video frames, inputting the frame image sets into a pre-trained low-illuminance image enhancement model to obtain enhanced frame images;
• and
• generating an enhanced video based on the enhanced frame images;
• wherein the performing image alignment on all frame images in the frame image sets corresponding to all video frames comprises:
• using a target video frame among all video frames as a reference frame image to perform motion estimation on each of supplementary frame images in the frame image set corresponding to the target video frame, so as to sequentially determine a motion vector corresponding to the each of the supplementary frame images in the frame image set corresponding to the target video frame, the supplementary frame images being the preceding frame images and the subsequent frame images in the frame image set and the target video frame being each video frame among all video frames;
• respectively performing motion compensation on each of the supplementary frame images based on the motion vector corresponding to each of the supplementary frame images;
• and
• concatenating the target video frame and each of the supplementary frame images subjected to motion compensation according to channels to obtain an aligned frame image set corresponding to the target video frame;
• wherein using the target video frame among all video frames as the reference frame image to perform motion estimation on each supplementary frame image in the frame image set corresponding to the target video frame, so as to sequentially determine the motion vector corresponding to each supplementary frame image in the frame image set corresponding to the target video frame comprises:
• inputting the target video frame and the preceding frame image into a pre-trained preceding frame image motion estimation model to obtain a motion vector corresponding to the preceding frame image;
• and
• inputting the target video frame and the subsequent frame image into a pre-trained subsequent frame image motion estimation model to obtain a motion vector corresponding to the subsequent frame image.

A non-transitory computer-readable storage medium storing one or more programs which, when executed by one or more processors, cause the one or more processors to carry out a low-illuminance video processing method comprising:

• acquiring a same number of preceding frame images and subsequent frame images corresponding to a current video frame of a low-illuminance video to obtain a frame image set corresponding to the current video frame, and performing traversal on the low-illuminance video to obtain frame image sets corresponding to all video frames;
• after performing image alignment on all frame images in the frame image sets corresponding to all video frames, inputting the frame image sets into a pre-trained low-illuminance image enhancement model to obtain enhanced frame images;
• and
• generating an enhanced video based on the enhanced frame images;
• wherein the performing image alignment on all frame images in the frame image sets corresponding to all video frames comprises:
• using a target video frame among all video frames as a reference frame image to perform motion estimation on each of supplementary frame images in the frame image set corresponding to the target video frame, so as to sequentially determine a motion vector corresponding to each of the supplementary frame images in the frame image set corresponding to the target video frame, the supplementary frame images being the preceding frame images and the subsequent frame images in the frame image set and the target video frame being each video frame among all video frames;
• respectively performing motion compensation on each of the supplementary frame images based on the motion vector corresponding to each of the supplementary frame images;
• and
• concatenating the target video frame and each of the supplementary frame images subjected to motion compensation according to channels to obtain an aligned frame image set corresponding to the target video frame;
• wherein using the target video frame among all video frames as the reference frame image to perform motion estimation on each supplementary frame image in the frame image set corresponding to the target video frame, so as to sequentially determine the motion vector corresponding to each supplementary frame image in the frame image set corresponding to the target video frame comprises:
• inputting the target video frame and the preceding frame image into a pre-trained preceding frame image motion estimation model to obtain a motion vector corresponding to the preceding frame image;
• and
• inputting the target video frame and the subsequent frame image into a pre-trained subsequent frame image motion estimation model to obtain a motion vector corresponding to the subsequent frame image.