System and method for computer vision driven applications within an environment

A method comprising:

• collecting image data across an environment;
• maintaining an environmental object graph from the image data whereby maintaining the environmental object graph is an iterative process comprising:
• classifying objects and storing corresponding object instances in the environmental object graph,
• tracking object locations and establishing an association of object instances in an object path,
• detecting interaction events and, for event instances of a subset of detected interaction events, generating an object association of at least two object instances involved in the interaction event, and
• updating the environmental object graph comprising propagating change in at least one object instance across object associations;
• and
• inspecting object state for at least one object instance in the environmental object graph and executing an action associated with the object state.

A system comprising

• an imaging system configured to collect image data within an environment;
• a processing engine configured to maintain an environmental object graph from the image data wherein the environmental object graph is a data representation of classified objects in space and time across the environment, the environmental object graph comprising at least a subset of objects having probabilistic object associations;
• and
• the processing engine further configured to:
• classify objects in the image data and store corresponding object instances in the environmental object graph,
• track object locations and establish an association of object instances in an object path,
• detect interaction events and, for event instances of a subset of detected interaction events, generate an object association of at least two object instances involved in the interaction event, and
• update the environmental object graph and propagate change in at least one object instance across object associations.