Inter-trajectory anomaly detection using adaptive voting experts in a video surveillance system

A non-transitory computer storage medium, which, when executed on a processor, performs an operation for evaluating objects detected in a video stream, comprising:

• detecting a first foreground object and a second foreground object in a single video stream, the first foreground object being different from the second foreground object;
• while the first foreground object and the second foreground object are present in the single video stream:
• building a first trajectory characterizing the first foreground object in a series of successive frames of the single video stream, and
• building a second trajectory characterizing the second foreground object in the series of successive frames of the single video stream;
• determining an anomalous interaction between the first foreground object and the second foreground object based on observing the first trajectory relative to the second trajectory.

A video surveillance system, comprising:

• a video source configured to provide a single input video stream captured by a video camera;
• a processor;
• and
• a memory containing a program, which, when executed on the processor is configured to perform an operation for evaluating objects detected in the single input video stream, the operation comprising:
• detecting a first foreground object and a second foreground object in the single input video stream, the first foreground object being different from the second foreground object,
• while the first foreground object and the second foreground object are present in the single video stream:
• building a first trajectory characterizing the first foreground object in a series of successive frames of the single video stream, and
• building a second trajectory characterizing the second foreground object in the series of successive frames of the single video stream;
• determining an anomalous interaction between the first foreground object and the second foreground object based on observing the first trajectory relative to the second trajectory.