Hand-related data annotations with an augmented reality device

A computer-implemented method comprising:

• performing a calibration operation to generate a three-dimensional (3-D) data model of a hand of a user based on measurements relating to the hand of the user;
• generating a 3-D virtual representation of a hand in a hand pose corresponding with a hand gesture, based on the 3-D data model of the hand of the user;
• presenting, in AR via a display, the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture;
• during presentation of the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture in AR, detecting an input;
• responsive to detecting the input, invoking at least one image sensor to capture an image of the hand of the user positioned to correspond with the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture;
• and
• storing the captured image of the hand of the user with corresponding hand annotations based on the 3-D data model of the hand of the user.

An AR device configured to generate hand annotations for an image depicting a hand of a user, the AR device comprising:

• means for performing a calibration operation to generate a 3-D data model of the hand of the user based on measurements relating to the hand of the user;
• means for generating a 3-D virtual representation of a hand in a hand pose corresponding with a hand gesture, based on the 3-D data model of the hand of the user;
• means for presenting, in AR via the display, the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture;
• during presentation of the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture in AR, means for detecting an input;
• responsive to detecting the input, means for invoking at least one image sensor to capture an image of the hand of the user positioned to correspond with the 3-D virtual representation of the hand in the hand pose corresponding with the hand gesture;
• and
• means for storing the captured image of the hand of the user with corresponding hand annotations based on the 3-D data model of the hand of the user.