Gesture-based shared AR session creation

A system comprising:

• a processor;
• and
• a memory having instructions stored thereon, when executed by the processor, causes the system to perform operations comprising:
• receiving an observed motion data from a first device associated with a first user, the first device generating the observed motion data based on an analysis of a data stream, the first device includes a camera that captures the data stream comprising video images of a second user performing a gesture as captured by the first user, the second user being associated with and coupled to a second device;
• receiving from the second device a captured motion data that is recorded by a sensor included in the second device, wherein the sensor captures position, movement and orientation of the second device;
• determining whether there is a match between the observed motion data from the first device and the captured motion data from the second device, wherein determining there is the match is based on the observed motion data and the captured motion data describing a same gesture being performed by the second user within a predetermined error threshold, wherein the gesture comprises a natural movement of the second user comprising a walking gait;
• and
• in response to determining that there is the match,
• generating a shared AR session between the first device and the second device;
• and
• causing the shared AR session to be displayed by the first device and by the second device.

A non-transitory computer-readable storage medium having stored thereon instructions, when executed by a processor, causes the processor to perform operations comprising:

• receiving an observed motion data from a first device associated with a first user, the first device generating the observed motion data based on an analysis of a data stream, the first device includes a camera that captures the data stream comprising video images of a second user performing a gesture as captured by the first user, the second user being associated with and coupled to a second device;
• receiving from the second device a captured motion data that is recorded by a sensor included in the second device, wherein the sensor captures position, movement and orientation of the second device;
• determining whether there is a match between the observed motion data from the first device and the captured motion data from the second device, wherein determining there is the match is based on the observed motion data and the captured motion data describing a same gesture being performed by the second user within a predetermined error threshold, wherein the gesture comprises a natural movement of the second user comprising a walking gait;
• and
• in response to determining that there is the match,
• generating a shared AR session between the first device and the second device;
• and
• causing the shared AR session to be displayed by the first device and by the second device.

A method comprising:

• capturing, using a camera included in a first device, a video of a user of a second device performing a gesture as captured by a first user of the first device, wherein the user of the second device is coupled to the second device;
• generating, by a processor included in the first device, an observed motion data based on an analysis of the video of the user of the second device;
• receiving, by the first device from the second device, a captured motion data that is recorded by a sensor included in the second device, wherein the sensor captures position, movement and orientation of the second device;
• determining, by the first device, whether there is a match between the observed motion data and the captured motion data from the second device, wherein determining there is the match is based on the observed motion data and the captured motion data describing a same gesture being performed by the user of the second device within a predetermined error threshold, wherein the gesture comprises a natural movement of the second user comprising a walking gait;
• and
• in response to determining that there is the match, transmitting a request to a server to generate a shared AR session between the first device and the second device.