Methods and systems to allow three-dimensional map sharing between heterogeneous computing systems, cross-localization, and sharing content in three-dimensional space

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

• access sensor data of a real environment captured by the first device;
• generate, based on the sensor data, a first plurality of feature descriptors for the real environment using a machine-learning model;
• generate a second plurality of feature descriptors for the real environment based on the first plurality of feature descriptors, wherein the second plurality of feature descriptors have lower detail than the first plurality of feature descriptors;
• transmit the first plurality of feature descriptors using a wireless connection, wherein the transmitted first plurality of feature descriptors are configured to be converted into a third plurality of feature descriptors different from the second plurality of feature descriptors, the third plurality of feature descriptors being configured to be used by a second artificial-reality device for tracking the real environment;
• and
• track the real environment using the second plurality of feature descriptors.

A system comprising:

• one or more processors;
• and
• one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
• access sensor data of a real environment captured by the first device;
• generate, based on the sensor data, a first plurality of feature descriptors for the real environment using a machine-learning model;
• generate a second plurality of feature descriptors for the real environment based on the first plurality of feature descriptors, wherein the second plurality of feature descriptors have lower detail than the first plurality of feature descriptors;
• transmit the first plurality of feature descriptors using a wireless connection, wherein the transmitted first plurality of feature descriptors are configured to be converted into a third plurality of feature descriptors different from the second plurality of feature descriptors, the third plurality of feature descriptors being configured to be used by a second artificial-reality device for tracking the real environment;
• and
• track the real environment using the second plurality of feature descriptors.