US 12,762,730 B1Granted

System and method for video analytics processing on dynamical content

AssigneeDimension, Inc.

InventorJames Anderson

Life of this patent

Estimating the term…

Loading patent…

Abstract

A multi-frame video analytics (MFVA) system is disclosed, in which contiguous video frame-sequences are processed in reconstruction of 3D dynamical relationships amongst tracked objects. A tensor-based spatiotemporal volume (STV) formalism mapped to buffered successive video-frames is employed. An optical flow field calculation is then applied to this STV for recovery of z-axis information. Standard dynamics in terms of position, velocity, and acceleration are then reconstructed via numerical approximation of time-derivatives on the set of spatiotemporal trajectories (STT) generated by tracked objects that together constitute a bounding STV. In this manner, STVs are rendered causal, with implication application of a suitable knowledge (KBASE) representation also generates an explanatory framework consisting of a set of primitive assertions on tracked objects, now informed by dynamical state, phase flow, and interaction events. This framework is then employed as basis for generation of an enhanced set of video analytics.

Claims11

Dependent claims

An iterative process for performing Multi-Frame Video Analysis (MFVA) on a video sequence, comprising:

storing the video sequence into a video buffer, the video sequence comprising a plurality of individual video frames;
extracting position data for one or more objects of interest within a particular frame of the video sequence;
forming a SpatioTemporal Plane (STP) associated with the particular frame;
applying one or more Kalman filter denoise mechanisms to the STP;
calculating an optical flow boundary for the one or more objects of interest within the particular frame;
applying a Neural Network classifier to the one or more optical flow boundaries suitable for calculation of possible z-axis motion within the particular frame;
calculating a SpatioTemporal Volume (STV) of the particular frame, thereby bringing the video sequence into a 3D computational modality;
calculating a dynamical state for the one or more objects of interest within the STV of the particular frame;
extracting dynamical attributes from the STV of the particular frame;
finishing processing of the particular frame and either displaying or storing that frame;
checking the video buffer for more frames;
and
if more frames exist within the video buffer, re-start the video sequence with the next frame,
if no more frames exist within the video buffer, cease processing and cease displaying any video.

11 more elements

Dependencies are inferred from the claim text.