Video retrieval method, device, and medium
AssigneeArmy Academy of Armored Forces of PLA
InventorsZhen Lei, Yong Li, Zhenwei Li, Qinghua Liang
Life of this patent
Estimating the term…
Loading patent…
AssigneeArmy Academy of Armored Forces of PLA
InventorsZhen Lei, Yong Li, Zhenwei Li, Qinghua Liang
Estimating the term…
This application provides a video retrieval method, a device, and a medium. The video retrieval method includes extracting a keyframe of a video from an Interactive Electronic Technical Manual (IETM) common source database (CSDB) in an IETM platform, transferring the keyframe to a Contrastive Language-Image Pre-training (CLIP) encoder, and storing the keyframe in a keyframe database. A CLIP image encoder is used to encode the keyframe to determine a fused vector of all keyframe features, and the fused vector is stored in a vector database as a video feature. A CLIP text encoder is used to encode video retrieval text to determine a text feature, and the text feature is stored in a text database. A similarity between the text feature and the video feature is calculated to determine a text-video similarity matrix. Video retrieval is performed based on the text-video similarity matrix, and determining a video retrieval result.
A video retrieval method, comprising:
Dependencies are inferred from the claim text.