System and method enabling a collaborative 3D map data fusion platform and virtual world system thereof

A system enabling an updatable 3D spatial map comprising:

• at least one server computer comprising memory and at least one processor, the memory storing a three-dimensional (3D) map data fusion platform, wherein the at least one server computer is configured to:
• provide in the 3D map data fusion platform a map comprising imagery of a real-world location;
• publish in the 3D map data fusion platform with reference to the map a real-time virtual replica network (RVRN), wherein the RVRN comprises a plurality of 3D virtual replicas, each of the 3D virtual replicas corresponding to a real-world object in the real-world location and comprising a plurality of object features, the object features including:
• a real-time position, orientation, and a 3D structure;
• obtain a pose of a first client device;
• initiate a simultaneous location and mapping (SLAM) process of a first coordinate space, wherein the SLAM process uses image data from an imaging device of the first client device and the pose of the first client device to determine a pose of a first plurality of features within the first coordinate space;
• create a first new map comprising 3D coordinates of the first plurality of features within the first coordinate space;
• and
• merge, by the 3D map data fusion platform, the first new map comprising the 3D coordinates of the first plurality of features within the first coordinate space with the published RVRN, creating a fused 3D map.

A non-transitory computer-readable medium having stored thereon computer-executable instructions configured to cause one or more processors to perform steps comprising:

• providing a three-dimensional (3D) map data fusion platform;
• providing in the 3D map data fusion platform a map comprising imagery of a real-world location;
• publishing in the 3D map data fusion platform with reference to the map a real-time virtual replica network (RVRN), wherein the RVRN comprises a plurality of 3D virtual replicas, each of the 3D virtual replicas corresponding to a real-world object in the real-world location and comprising a plurality of object features, the object features including:
• a real-time position, orientation, and a 3D structure;
• obtaining a pose of a first client device;
• performing a simultaneous location and mapping (SLAM) process of a first coordinate space, wherein the SLAM process uses image data from an imaging device of the first client device, the pose of the first client device and data of the map to determine a pose of a first plurality of features within the first coordinate space;
• creating a new map comprising 3D coordinates of the first plurality of features within the first coordinate space;
• and
• merging, by the 3D map data fusion platform, the first new map comprising the 3D coordinates of the first plurality of features within the first coordinate space with the published RVRN, creating a fused 3D map.