Device colocalization for shared augmented reality

A non-transitory computer-readable medium storing instructions that, when executed by a computing system, cause the computing system to perform operations comprising:

• receiving, in a first coordinate system from a first client device and at a server, a first mesh of a field of view of the first client device, wherein the first mesh is generated by the first client device from a depth map;
• receiving, in the first coordinate system from the first client device and at the server, a position of a second client device in the field of view of the first client device;
• receiving, in a second coordinate system from the second client device and at the server, a second mesh of a field of view of the second client device and a location of the second client device;
• and
• colocalizing the second client device to the first coordinate system of the first client device for a shared virtual experience between the first and second client devices by identifying a transformation for mesh alignment of the second mesh to the first mesh based on the position of the second client device in the first coordinate system.

A server for providing a shared virtual experience between a plurality of client devices, the server comprising:

• one or more processors;
• and
• a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• receiving, in a first coordinate system from a first client device and at a server, a first mesh of a field of view of the first client device, wherein the first mesh is generated by the first client device from a depth map;
• receiving, in the first coordinate system from the first client device and at the server, a position of a second client device in the field of view of the first client device;
• receiving, in a second coordinate system from the second client device and at the server, a second mesh of a field of view of the second client device and a location of the second client device;
• and
• colocalizing the second client device to the first coordinate system of the first client device for the shared virtual experience by identifying a transformation for mesh alignment of the second mesh to the first mesh based on the position of the second client device in the first coordinate system.