Shared augmented reality eyewear device with hand tracking alignment

A machine comprising:

• at least one processor;
• and
• at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
• capturing, by a set of user devices, respective timestamps upon entering an XR session;
• selecting a first user device of the set of user devices having an oldest timestamp as a reference device;
• capturing, by a camera of the first user device, an image of a hand of a user;
• performing, by the first user device, object recognition on the image to identify joints of the hand as somatic points;
• determining, by the first user device, a set of positions of the somatic points in a coordinate system of the first user device;
• generating a reference data set using the set of positions;
• transmitting the reference data set to one or more second user devices of the set of user devices;
• and
• aligning the one or more second user devices to the coordinate system of the first user device using the reference data set.

A machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:

• capturing, by a set of user devices, respective timestamps upon entering an XR session;
• selecting a first user device of the set of user devices having an oldest timestamp as a reference device;
• capturing, by a camera of the first user device, an image of a hand of a user:
• performing, by the first user device, object recognition on the image to identify joints of the hand as somatic points;
• determining, by the first user device, a set of positions of the somatic points in a coordinate system of the first user device;
• generating a reference data set using the set of positions;
• transmitting the reference data set to one or more second user devices of the set of user devices;
• and
• aligning the one or more second user devices to the coordinate system of the first user device using the reference data set.