Automatic threat detection based on video frame delta information in compressed video streams

A system to detect an event in compressed video, comprising:

• a plurality of surveillance cameras, each of the plurality of surveillance cameras comprising:
• a video encoder, configured to compress video and emit frames of a compressed video stream comprising video frame delta information, wherein said video frame delta information excludes redundant data in the form of pixels in each frame that do not change relative to a reference frame and identifies pixels that have changed relative to a prior frame;
• a processor, communicatively coupled to the video encoder;
• a memory that is not a transitory propagating signal, the memory connected to the processor and encoding computer readable instructions, including processor executable program instructions, the computer readable instructions accessible to the processor, wherein the processor executable program instructions, when executed by the processor, cause the processor to perform operations comprising:
• receiving, from the video encoder, a series of video frames comprising video frame delta information;
• and
• identifying objects of interest and detecting motion to detect a security threat as a function of the video frame delta information;
• and
• a cloud server communicatively coupled to the plurality of surveillance cameras, the cloud server comprising:
• a second processor, operably coupled to a memory that is not a transitory propagating signal, the memory connected to the second processor and comprising second computer readable instructions, including second processor executable program instructions, the second computer readable instructions accessible to the second processor, wherein the second processor executable program instructions, when executed by the second processor, cause the processor to perform operations comprising:
• sending, to at least one surveillance camera, an electronic message comprising a pattern representative of an event to be detected;
• and
• receiving, from the at least one surveillance camera, an electronic message comprising an indication of a detected event based at least in part on said pattern representative of said event,
• wherein the cloud server memory further comprises a predictive model adapted to estimate an event probability determined as a function of video frame delta information;
• the operations performed by the cloud server processor further comprise sending the predictive model to the surveillance camera;
• and the operations performed by the surveillance camera processor further comprise:
• receiving the predictive model from the cloud server;
• estimating an event probability determined as a function of video frame delta information applied as input data to the predictive model;
• and upon a determination the estimate of the event probability satisfies a predetermined criterion, sending the estimate of the event probability to the cloud server.