Method and system for performing content aware multi-object tracking

A system, comprising:

• a memory storing instructions;
• one or more communication interfaces;
• and
• one or more hardware processors coupled to the memory via the one or more communication interfaces, wherein the one or more hardware processors are configured by the instructions to:
• receive a video sequence of a captured video on which multi-object tracking needs to be performed, and a frame skip information, wherein the video sequence comprises a plurality of frames, wherein the frame skip information comprises a frame skip number, and wherein the frame skip number refers to a number of frames to be skipped during the multi-object tracking;
• select one or more frames from the plurality of frames based on a predefined criteria, wherein the selected one or more frames are referred as a group of frames (GOF);
• identify a plurality of objects present in the GOF using an object detection algorithm;
• categorize each object of the plurality of objects that are present in the GOF in a predefined object group of one or more predefined object groups using an object categorization technique, wherein the one or more predefined object groups comprise a fast motion object group and a slow motion object group;
• identify a prevalent predefined object group among the one or more predefined object groups in the GOF, wherein the prevalent predefined object group is identified based on a probability score assigned to each object during categorization;
• determine whether the prevalent predefined object group is the fast motion object group;
• apply a computation intensive deep sort algorithm on at least one frame of the plurality of frames based on the frame skip number to perform tracking of the plurality of objects present in the captured video in a skipping manner;
• and
• perform a quadratic interpolation on one or more skipped frames present in the captured video to perform tracking of the plurality of objects present in the captured video upon determining that the prevalent predefined object group is the fast motion object group, wherein the one or more skipped frames refers to at least one remaining frame in the plurality of frames on which the computation intensive deep sort algorithm is not applied, and wherein the quadratic interpolation is a low computation tracking technique, thereby reducing the computational load of the system.

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors cause:

• receiving, by a system, a video sequence of a captured video on which multi-object tracking needs to be performed, and a frame skip information, wherein the video sequence comprises a plurality of frames, wherein the frame skip information comprises a frame skip number, and wherein the frame skip number refers to a number of frames to be skipped during the multi-object tracking;
• selecting, by the system, one or more frames from the plurality of frames based on a predefined criteria, wherein the selected one or more frames are referred as a group of frames (GOF);
• identifying, by the system, a plurality of objects present in the GOF using an object detection algorithm;
• categorizing, by the system, each object of the plurality of objects that are present in the GOF in a predefined object group of one or more predefined object groups using an object categorization technique, wherein the one or more predefined object groups comprise a fast motion object group and a slow motion object group;
• identifying, by the system, a prevalent predefined object group among the one or more predefined object groups in the GOF, wherein the prevalent predefined object group is identified based on a probability score assigned to each object during categorization;
• determining, by the system, whether the prevalent predefined object group is the fast motion object group;
• applying, by the system, a computation intensive deep sort algorithm on at least one frame of the plurality of frames based on the frame skip number to perform tracking of the plurality of objects present in the captured video in a skipping manner;
• and
• performing, by the system, a quadratic interpolation on one or more skipped frames present in the captured video to perform tracking of the plurality of objects present in the captured video upon determining that the prevalent predefined object group is the fast motion object group, wherein the one or more skipped frames refers to at least one remaining frame in the plurality of frames on which the computation intensive deep sort algorithm is not applied, and wherein the quadratic interpolation is a low computation tracking technique, thereby reducing the computational load of the system.