Translating procedural documentation into contextual visual and auditory guidance

A non-transitory computer readable storage medium comprising a computer readable program for assisting a user performing a procedure, wherein the computer readable program when executed on a computer causes the computer to perform the steps of:

• capturing, by a camera, images of user activity while the user is performing the procedure;
• converting, by computer processing system, the images of user activity into a text representation of user activity;
• comparing, by the computer processing system, the textual representation of user activity to procedure documentation;
• and
• visually or audibly indicating, by a display or a speaker, a corrective action to the user responsive to a mismatch result from said comparing step.

A system for assisting a user performing a procedure, the method comprising:

• a camera for capturing images of user activity while the user is performing the procedure;
• a computer processing system for converting the images of user activity into a text representation of user activity, and comparing the textual representation of user activity to procedure documentation;
• and
• a display or speaker for at least one of visually and audibly indicating a corrective action to the user responsive to a mismatch result from said comparing step.