Real-time motion transfer for prosthetic limbs

A system comprising:

• one or more processors configured to perform operations comprising:
• accessing a video that depicts an object;
• identifying a set of skeletal joints corresponding to limbs of the object;
• tracking three-dimensional (3D) movement of the set of skeletal joints corresponding to the limbs of the object depicted in the video;
• causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the object in the video;
• computing a 3D position for placement of the 3D virtual object relative to a 3D reference point of the object;
• causing the 3D virtual object to be displayed within the video at the 3D position;
• and
• updating the 3D position of the 3D virtual object in the video based on one or more changes to the 3D reference point of the object.

A non-transitory machine-readable storage medium including an augmented reality system that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

• accessing a video that depicts an object;
• identifying a set of skeletal joints corresponding to limbs of the object;
• tracking three-dimensional (3D) movement of the set of skeletal joints corresponding to the limbs of the object depicted in the video;
• causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the object in the video;
• computing a 3D position for placement of the 3D virtual object relative to a 3D reference point of the object;
• causing the 3D virtual object to be displayed within the video at the 3D position;
• and
• updating the 3D position of the 3D virtual object in the video based on one or more changes to the 3D reference point of the object.