System and method for dynamically ordering video channels according to rank of abnormal detection

A method for dynamically ordering sensor data on display in a command and control system according to sensor content, the method comprising:

• obtaining a plurality of data streams captured by a plurality of respective sensors;
• extracting features from the plurality of data streams including a feature that is an output of an intermediate layer in-between other layers of a neural network implementing an activity recognition deep learning classifier;
• calculating abnormality scores for the extracted features, wherein each abnormality score measures a likelihood that a corresponding feature is an abnormal feature;
• calculating a current rank for ordering each of the plurality of data streams based on current and past abnormality scores of the features extracted from the data stream;
• and
• displaying, on a video layout array of a plurality of display slots, a subgroup of the plurality of data streams having the highest subset of current ranks based on abnormality scores, wherein the plurality of video streams in the subgroup are arranged in the plurality of display slots of the video layout array in order of their current ranks.

A system for dynamically ordering video streams on display in a command and control system according to video content, the system comprising:

• a processor configured to:
• obtain a plurality of video streams captured by a plurality of respective video cameras;
• extract features from the plurality of video streams including a feature that is an output of an intermediate layer in-between other layers of a neural network implementing an activity recognition deep learning classifier;
• calculate abnormality scores for the extracted features, wherein each abnormality score measures a likelihood that a corresponding feature is an abnormal feature;
• calculate a current rank for ordering each of the plurality of video streams based on current and past abnormality scores of the features extracted from the video stream;
• and
• select a subgroup of the plurality of video streams having the highest subset of current ranks based on abnormality scores;
• and
• a display comprising a video layout array of a plurality of display slots for displaying the subgroup of the plurality of video streams having the highest subset of current ranks, wherein the display is configured to arrange the plurality of video streams in the subgroup in the plurality of display slots of the video layout array in order of their current ranks.