Video super-resolution method and device
AssigneeBeijing Zitiao Network Technology Co., Ltd.
InventorHang DONG
Life of this patent
Estimating the term…
Abstract
Embodiments of the present invention provide a video super-resolution method and apparatus, the method including: acquiring a first feature; processing the first feature by concatenated multistage residual dense blocks (RDBs) to obtain a fusion feature output by a RDB in each stage; for the fusion feature output by the RDB in each stage, aligning each of neighborhood features of the fusion feature with a target feature of the fusion feature to obtain an alignment feature corresponding to the RDB that outputs the fusion feature; and generating a super-resolution video frame corresponding to the target video frame on the basis of the alignment feature corresponding to the RDB in each stage and the initial feature of the target video frame.
Claims20
A video super-resolution method, comprising:
- acquiring a first feature, wherein the first feature is a feature obtained by merging an initial feature of a target video frame and an initial feature of each of neighborhood video frames of the target video frame;
- processing the first feature by concatenated multistage residual dense blocks (RDBs) to obtain a fusion feature output by a RDB in each stage;
- for the fusion feature output by the RDB in each stage, aligning each of neighborhood features of the fusion feature with a target feature of the fusion feature to obtain an alignment feature corresponding to the RDB that outputs the fusion feature, wherein each of the neighborhood features of the fusion feature is a feature corresponding to each of the neighborhood video frames, and the target feature of the fusion feature is a feature corresponding to the target video frame;
- and
- generating a super-resolution video frame corresponding to the target video frame on the basis of the alignment feature corresponding to the RDB in each stage and the initial feature of the target video frame.
(canceled)
An electronic device, comprising a memory and a processor, the memory being configured to store a computer program, the processor being configured to, when executing the computer program, cause the electronic device to implement:
- acquiring a first feature, wherein the first feature is a feature obtained by merging an initial feature of a target video frame and an initial feature of each of neighborhood video frames of the target video frame;
- processing the first feature by concatenated multistage residual dense blocks (RDBs) to obtain a fusion feature output by a RDB in each stage;
- for the fusion feature output by the RDB in each stage, aligning each of neighborhood features of the fusion feature with a target feature of the fusion feature to obtain an alignment feature corresponding to the RDB that outputs the fusion feature, wherein each of the neighborhood features of the fusion feature is a feature corresponding to each of the neighborhood video frames, and the target feature of the fusion feature is a feature corresponding to the target video frame;
- and
- generating a super-resolution video frame corresponding to the target video frame on the basis of the alignment feature corresponding to the RDB in each stage and the initial feature of the target video frame.
A computer-readable storage medium, the computer-readable storage medium storing a computer program which, when executed by a computing device, causing the computing device to implement;
- acquiring a first feature, wherein the first feature is a feature obtained by merging an initial feature of a target video frame and an initial feature of each of neighborhood video frames of the target video frame;
- processing the first feature by concatenated multistage residual dense blocks (RDBs) to obtain a fusion feature output by a RDB in each stage;
- for the fusion feature output by the RDB in each stage, aligning each of neighborhood features of the fusion feature with a target feature of the fusion feature to obtain an alignment feature corresponding to the RDB that outputs the fusion feature, wherein each of the neighborhood features of the fusion feature is a feature corresponding to each of the neighborhood video frames, and the target feature of the fusion feature is a feature corresponding to the target video frame;
- and
- generating a super-resolution video frame corresponding to the target video frame on the basis of the alignment feature corresponding to the RDB in each stage and the initial feature of the target video frame.
(canceled)
Dependencies are inferred from the claim text.