Monitoring of a project by video analysis

A method, comprising:

• via a processor of a device performing:
• defining project monitoring metrics for a project that monitors a target area associated with a product;
• configuring a camera and a microphone for capturing video and audio within the target area before a project start date and time based on criteria defining the project, a size of the target area, dimensions of the target area, and physical object sizes of physical objects in the target area that are obtain from a list of the physical objects;
• wherein configuring further includes:
• sending instructions to an autonomous robot to travel to the target area before the project start date and time and send the video and the audio for a targeted portion of the target area;
• and
• processing filters that filters out background noise from the audio and that identifies irrelevant background images that are not associated with the target area from the video captured by the camera of the autonomous robot;
• tracking a customer and the product as objects identified from the video;
• identifying behaviors of the customer with respect to the product based on the tracking and the audio;
• deriving intentions of the customer with respect to the product based on the behaviors and the project monitoring metrics;
• maintaining the audio, the video, the behaviors, the intentions, and the project monitoring metrics within a data store;
• and
• providing an interface to permit custom query processing, custom reporting, and custom notifications of the project monitoring metrics.

A system, comprising:

• a server comprising a processor and a non-transitory computer-readable storage medium having executable instructions representing a mission correlator;
• the mission correlator when executed by the processor from the non-transitory computer-readable storage medium is configured to cause the processor to:
• obtain mission metrics and a location identifying a target area;
• configure audio/visual resources to provide audio and video streams from the target area during a mission monitoring period based on a size of the target area and dimensions of the target area and based on physical object sizes of physical objects within the target area obtained from a list of physical objects, wherein configuring the audio/visual resources further includes:
• send instructions to an autonomous robot to travel to the target area before the project start date and time and send audio and video a targeted portion of the target area;
• and
• process filters that filters out background noise from the audio and that identifies irrelevant background images that are not associated with the target portion from the video captured by a camera of the autonomous robot;
• track behaviors of a customer with respect to an object present within the target area from the audio and the video;
• derive intentions of the customer with respect to the object based on the behaviors and the mission metrics;
• index and correlate the audio, the video, the behaviors, the intentions, and the mission metrics within a data store;
• and
• provide an interface to query, report, and notify from the data store based on custom criteria defined through the interface.