Detecting anomalous events using a long-term memory in a video analysis system

A computer-readable storage medium containing a program which, when executed by a processor, performs an operation for detecting anomalous events using a long-term memory in a video analysis system configured to observe patterns of behavior depicted in a sequence of video frames, the operation comprising:

• receiving an active percept, wherein the active percept comprises a sub-graph of a neural network excited by a semantic symbol stream, wherein the semantic symbol stream describes objects depicted in the sequence of video frames;
• querying the long-term memory using the active percept as an input stimulus;
• receiving, in response to the querying, a retrieved percept from the long-term memory and an occurrence frequency (F) of the retrieved percept, wherein the retrieved percept encodes a pattern of behavior previously observed by the video analysis system;
• and
• determining a distance (d) between the active percept and the retrieved percept;
• upon determining the distance (d) exceeds a specified threshold, publishing an alert notification indicating the occurrence of an anomalous event, as represented by the active percept.

A system comprising,

• a video input source configured to provide a sequence of video frames, each depicting a scene;
• a processor;
• and
• a memory containing a machine learning application which when executed by the processor is configured to perform an operation for detecting anomalous events using a long-term memory in a video analysis system configured to observe patterns of behavior depicted in a sequence of video frames, the operation comprising:
• receiving an active percept, wherein the active percept comprises a sub-graph of a neural network excited by a semantic symbol stream, wherein the semantic symbol stream describes objects depicted in the sequence of video frames;
• querying the long-term memory using the active percept as an input stimulus;
• receiving, in response to the querying, a retrieved percept from the long-term memory and an occurrence frequency (F) of the retrieved percept, wherein the retrieved percept encodes a pattern of behavior previously observed by the video analysis system;
• and
• determining a distance (d) between the active percept and the retrieved percept;
• upon determining the distance (d) exceeds a specified threshold, publishing an alert notification indicating the occurrence of an anomalous event, as represented by the active percept.