Self guidance based on dimensional relationship

A non-transitory computer-readable storage media that configures a computer to perform program instructions stored on the non-transitory computer-readable storage media, the program instructions comprising:

• receiving a plurality of images from a user device utilized by a user performing a task on a unit, the images corresponding to a perspective that the user is viewing the unit;
• determining whether a current image of the images and a previous image of the images include a number of corresponding three-dimensional points geometrically aligning the current image and the previous image that is at least a registration threshold to perform a three-dimensional registration operation;
• as a result of the number of corresponding three-dimensional points being less than the registration threshold, performing a three-dimensional data augmentation operation based on two-dimensional data from the current image and the previous image to generate extended corresponding three-dimensional points;
• determining a three-dimensional transform function between the current image and the previous image based on the extended corresponding three-dimensional points;
• and
• generating annotations to be shown for the unit in the current image based on the three-dimensional transform function, the annotations being shown as a virtual rendering in a mixed reality environment viewed by the user.

A computer system for guiding a user through dimensional relationships, the computer system comprising:

• one or more computer processors, one or more computer-readable storage media, and program instructions stored on the one or more of the computer-readable storage media for execution by at least one of the one or more processors capable of performing a method, the method comprising:
• receiving a plurality of images from a user device utilized by a user performing a task on a unit, the images corresponding to a perspective that the user is viewing the unit;
• determining whether a current image of the images and a previous image of the images include a number of corresponding three-dimensional points geometrically aligning the current image and the previous image that is at least a registration threshold to perform a three-dimensional registration operation;
• as a result of the number of corresponding three-dimensional points being less than the registration threshold, performing a three-dimensional data augmentation operation based on two-dimensional data from the current image and the previous image to generate extended corresponding three-dimensional points;
• determining a three-dimensional transform function between the current image and the previous image based on the extended corresponding three-dimensional points;
• and
• generating annotations to be shown for the unit in the current image based on the three-dimensional transform function, the annotations being shown as a virtual rendering in a mixed reality environment viewed by the user.