System and Method for Detecting Objects in Video Sequences

A method for detecting at least one object in a sequence of video frames, wherein the method uses a processor coupled with stored instructions implementing the method, wherein the instructions, when executed by the processor carry out at least some steps of the method comprising:

• accepting a sequence of video frames;
• processing each video frame sequentially with a neural network to detect objects in the sequence of video frames, wherein the neural network includes a first subnetwork, a second subnetwork, and a third subnetwork, wherein the first subnetwork receives as an input a video frame and outputs a feature map of the video frame, wherein the second subnetwork is a recurrent neural network that takes the feature map as an input and outputs a temporal feature map, and wherein the third subnetwork takes the temporal feature map as an input and outputs object detection information;
• and
• outputting the object detection information.

A non-transitory computer readable storage medium embodied thereon a program executable by a processor for performing a method, the method comprising:

• accepting a sequence of video frames;
• processing each video frame sequentially with a neural network to detect objects in the sequence of video frames, wherein the neural network includes a first subnetwork, a second subnetwork, and a third subnetwork, wherein the first subnetwork receives as an input a video frame and outputs a feature map of the video frame, wherein the second subnetwork is a recurrent neural network that takes the feature map as an input and outputs a temporal feature map, and wherein the third subnetwork takes the temporal feature map as an input and outputs object detection information;
• and
• outputting the object detection information.