Hand-related data annotations with an augmented reality device

A method for generating a personalized three-dimensional (3-D) data model of a hand of a user using an augmented reality (AR) device comprising a display, a processor, two or more image sensors, and a memory, the method comprising:

• presenting, in AR via the display, an animation of a 3-D virtual representation of a hand performing a hand gesture;
• prompting the user to position and move the hand of the user to correspond with the animation of the 3-D virtual representation of the hand performing the hand gesture;
• while the animation is being presented, capturing, via at least one of the two or more image sensors, one or more images of the hand of the user positioned to correspond with the 3-D virtual representation of the hand;
• and
• providing the one or more captured images as input to a pre-trained hand pose estimation model to generate the personalized 3-D data model of the hand of the user.

A non-transitory computer-readable medium storing instructions thereon, which, when executed by a processor of an augmented reality (AR) device comprising a display, two or more image sensors, and the processor, cause the AR device to perform operations comprising:

• presenting, in AR via the display, an animation of a 3-D virtual representation of a hand performing a hand gesture;
• prompting a user to position and move a hand of the user to correspond with the animation of the 3-D virtual representation of the hand performing the hand gesture;
• while the animation is being presented, capturing, via at least one of the two or more image sensors, one or more images of the hand of the user positioned to correspond with the 3-D virtual representation of the hand;
• and
• providing the one or more captured images as input to a pre-trained hand pose estimation model to generate a personalized three-dimensional (3-D) data model of the hand of the user.