Wide-area site-based video surveillance system

A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the software comprising:

• a data receiver module, adapted to receive and synchronize surveillance data, including view targets, from a plurality of sensors at a site;
• and
• a data fusion engine, adapted to receive said synchronized data, wherein said data fusion engine comprises:
• a site model manager, comprising:
• a map-based calibrator, adapted to calibrate a sensor view to said site map and store said calibration in a map-view mapping;
• a view-based calibrator, adapted to calibrate a view to an expected average human size and store said calibration in said human size map;
• and a camera network model manager, adapted to create and store said sensor network model, wherein said site model manager is adapted to maintain a site model, and wherein said site model comprises a site map, a human size map, and a sensor network model;
• a target fusion engine, adapted to analyze said synchronized data using said site model to determine if said view targets represent a same physical object in the site, and create a map target corresponding to a physical object in the site, wherein said map target comprises at least one view target;
• and
• an event detect and response engine, adapted to detect an event of interest based on a behavior of said map target, wherein said map-based calibrator includes a static camera calibrator, a point-tilt-zoom (PTZ) camera calibrator, and an omni-camera calibrator, and
• wherein said PTZ camera calibrator is adapted to:
• (a) estimate a homograph using a set of control points from said site map;
• (b) estimate an effective field of view for each sensor from said homograph;
• (c) estimate initial PTZ camera parameters, including at least one of camera map location, camera height, pan, tilt, roll, zoom, or relative focal length compared to image size;
• (d) refine said camera parameters such that said camera parameters are consistent with said homograph;
• (e) produce a new set of control points;
• and
• (f) repeat steps (a) through (e) until an acceptable error based on said control points is achieved.

A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the software comprising:

• a data receiver module, adapted to receive and synchronize surveillance data, including view targets, from a plurality of sensors at a site;
• and
• a data fusion engine, adapted to receive said synchronized data, wherein said data fusion engine comprises:
• a site model manager, adapted to maintain a site model, wherein said site model comprises a site map, a human size map, and a sensor network model;
• a target fusion engine, adapted to analyze said synchronized data using said site model to determine if said view targets represent a same physical object in the site, and create a map target corresponding to a physical object in the site, wherein said map target comprises at least one view target;
• and
• an event detect and response engine, adapted to detect an event of interest based on a behavior of said map target,
• wherein said human size map comprises a data structure based on a frame size that provides, at each image position in said frame, an expected average human image height and image area, and
• wherein when a camera-to-map calibration is not available, a view-based calibrator is adapted to construct said data structure by:
• detecting and tracking a potential human object in a view over a time period;
• when said potential human object satisfies a human head model and a human shape model for a specified duration, updating a human size statistic data structure with a size of said potential human object, wherein each section of said human size statistic data structure corresponds to a section of said view, and represents the average size of a human detected in said section of said view;
• and
• for a section in said human size statistic data structure with insufficient data, interpolating values from surrounding sections to determine an average for said section in said table with insufficient data.