Loading patent…
AssigneeNanjing University of Aeronautics and Astronautics
InventorsMeng Ding, Yuanyuan Ding, Xianghao Kong, Yiming Xu, Yi Wu, Wei Lu
Estimating the term…
The present disclosure discloses a method and system for recognizing human action in an apron based on thermal infrared vision, the method comprises: acquiring a plurality of video sequences from an infrared monitoring video; labeling a set target in each image frame in each video sequence with a target box to obtain a target tracking result; intercepting, for each image frame in the video sequence, a target-box enlarged area according to the labeled target box; adding, for each image frame in the video sequence, the position information of the image labeled with target box to the target-box enlarged area to obtain a three-channel sub-image; training an action recognition model by using three-channel sub-image sequences corresponding to a plurality of video sequences as a training set, to obtain a trained action recognition model; obtaining a to-be-recognized video sequence from another infrared monitoring video, and obtaining a three-channel sub-image sequence corresponding to the to-be-recognized video sequence; inputting the three-channel sub-image sequence corresponding to the to-be-recognized video sequence into the trained action recognition model to output a target action type.
A method for recognizing a human action in an apron based on thermal infrared vision, comprising:
The method according to 1, wherein the action recognition model includes a spatial feature extraction network and a spatiotemporal feature extraction network, an output of the spatial feature extraction network is connected to an input of the spatiotemporal feature extraction network;
The method according to 1, wherein an input of the action recognition model is a three-channel sub-image sequence of 30 frames.
The method according to 1, wherein the action recognition model also includes a Softmax function, and the Softmax function is used to determine classification results.
The method according to 1, wherein the target-box enlarged area is a square, and a side length of the square is expressed as:
A system for recognizing a human action in an apron based on thermal infrared vision, comprising:
The system according to 6, wherein the action recognition model includes a spatial feature extraction network and a spatiotemporal feature extraction network, an output of the spatial feature extraction network is connected to an input of the spatiotemporal feature extraction network;
The system according to 6, wherein an input of the action recognition model is a three-channel sub-image sequence of 30 frames.
The system according to 6, wherein the action recognition model also includes a Softmax function, and the Softmax function is used to determine classification results.
The system according to 6, wherein the target-box enlarged area is a square, and a side length of the square is expressed as:
Dependencies are inferred from the claim text.