Fusion based method for in-vehicle violence detection using cameras

A method to detect and fuse in-vehicle violence using cameras, comprising:

• positioning a standard vehicle camera within a vehicle capturing images of at least one occupant of the vehicle;
• locating a high speed event camera within the vehicle capturing motion images of the at least one occupant;
• dividing a camera image into grids differentiated as positive and negative events, the grids having multiple grid cells individually having an event count quantity indicating a quantity of changed events registered in the grid cells representing the camera image over a time interval;
• creating a circular buffer to track quantity changes in individual ones of the multiple grid cells over the time interval;
• updating the event count quantity for every time interval Δt, where Δt=tk+1−tk, and populating a next grid having multiple grid cells;
• moving a pointer to a next one of the grid cells of the next grid, and updating the next one of the grid cells;
• and
• identifying a changing count of the next one of the grid cells using a circular buffer.

A method to detect and fuse in-vehicle violence using cameras, comprising:

• positioning a standard vehicle camera within a vehicle capturing images of at least one occupant of the vehicle;
• locating an event camera within the vehicle capturing motion images of the at least one occupant;
• generating a standard vehicle camera-based region of interest (ROI) signal;
• generating an event camera-based ROI signal;
• applying an ROI fusion module to receive and fuse the event camera-based ROI signal and the standard vehicle camera-based ROI signal and to generate a fused ROI signal;
• sending the fused ROI signal to a threat evaluation module to augment the fused ROI signal with saved data to assist in differentiating normal events from violent or threat events;
• and
• identifying the threat events to the at least one occupant of the vehicle using an event camera-based violence indicator.