Intelligent Agents for Managing Data Associated with Three-Dimensional Objects

A system for managing data associated with real-world objects and virtual objects displayed in a communication session comprising:

• one or more data processing units;
• and
• a computer-readable medium having encoded thereon computer-executable instructions to cause the one or more data processing units to:
• receive, at the system, sensor data generated by a depth map sensor, the sensor data comprising depth map data defining a three-dimensional model of at least one real-world object within a real-world environment;
• receive model data defining virtual objects for display within a view of the real-world environment;
• generate data defining a plurality of agent instances, the individual agent instances having an associated database for individual virtual objects and individual real-world objects of interest that are identified by an analysis of the model data and the depth map data;
• monitor user interaction data of a plurality of users of the communication session from one or more input devices for identifying keywords, descriptions, or parameters to be stored within individual databases of the individual agent instance associated with the individual real-world objects or the individual virtual objects;
• and
• persistently store data defining the keywords, descriptions, or parameters within the individual databases of the individual agent instances associated with the individual virtual objects or the individual real-world objects for access by remote computing devices participating in multiple communication sessions.

A system for managing data associated with real-world objects and virtual objects displayed in a communication session, comprising:

• means for receiving sensor data generated by a depth map sensor and an image sensor, the sensor data comprising image data of real-world objects and depth map data defining a three-dimensional model of at least one real-world object positioned within a real-world environment;
• means for receiving model data defining virtual objects for display within a view of the real-world environment;
• means for generating data defining a plurality of agent instances, the individual agent instances having an associated database for individual virtual objects and individual real-world objects of interest that are identified by an analysis of the depth map data and the image data;
• means for monitoring communication data of a plurality of users of the communication session for identifying keywords, descriptions, or parameters to be stored within individual databases of the individual agent instance associated with the individual virtual objects or the individual real-world objects;
• and
• means for persistently storing data defining the keywords, descriptions, or parameters within the individual databases of the individual agent instances associated with the individual virtual objects or the individual real-world objects for access by remote computing devices participating in multiple communication sessions.