Information integration method, information integration device, and information integration program

An information integration device which is included in a transmission device for synchronously transmitting media information and sensor information on an object in a first space to a second space, the information integration device comprising:

• a sensor information reception unit, including one or more processors, configured to receive, as sensor information, a Depth map of an object and tracking data including label areas, which are areas of the object in an image, and a label indicating the object;
• and
• a labeling unit, including one or more processors, configured to associate a label corresponding to the label area included in the tracking data with an object area having a largest ratio of overlapping areas, among a plurality of object areas included in the Depth map, overlapping the label areas included in the tracking data with respect to the object areas or an object area having a largest size of the overlapping areas overlapping the label areas included in the tracking data.

A non-transitory computer readable medium storing an information integration program for causing a computer to execute:

• a first step of receiving, as sensor information, a Depth map of an object and tracking data including label areas, which are areas of the object in an image, and a label indicating the object;
• and
• a second step of associating a label corresponding to the label area included in the tracking data with an object area having a largest ratio of overlapping areas, among a plurality of object areas included in the Depth map, overlapping the label areas included in the tracking data with respect to the object areas or an object area having a largest size of the overlapping areas overlapping the label areas included in the tracking data.