Method and system for video temporal action proposal generation

Abstract

A system and method for video temporal action proposal generation are provided. It processes video features extracted from the input video through an encoder to obtain video encoding features with global information, extracts corresponding interest segment features from the video encoding features using pre-trained proposal segments, and provides them to the decoder. The decoder generates segment features based on the interest segment features corresponding to each proposal segment and the pre-trained proposal features. These are then provided to the prediction module, generating temporal action proposal results based on the decoder's segment features. The solution in embodiments of the present invention can effectively capture global context information of the video, obtaining video encoding features with stronger representational capabilities; By introducing the several learnable proposal segments to extract the corresponding position-based feature sequences from the video encoding features, the training convergence speed is enhanced, and computational burden is reduced.

Dependencies are inferred from the claim text.