Interactive text recognition by a head-mounted device

A computer program product for assisting a user in an environment, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to perform a method comprising:

• capturing, by a head-mounted device, a video stream that includes a first set of images;
• receiving, by the head-mounted device, a verbal context from the user;
• performing, by an assistance engine, an optical character recognition (OCR) process to generate a textual status based on the verbal context and the video stream;
• generating, by the assistance engine, an auditory response based upon the textual status;
• and
• playing, by the head-mounted device, the auditory response to the user.

A method of assisting a user in an environment, the method comprising:

• capturing, by a head-mounted device, a first set of images;
• performing, by an assistance engine, a first optical character recognition (OCR) process on the first set of images to generate a first content evaluation related to a segment of text in the environment;
• generating, by the assistance engine, an auditory command based on the first content evaluation;
• playing, by the head-mounted device, the auditory command to the user;
• capturing, by the head-mounted device, a second set of images subsequent to movement of the user in response to the auditory command;
• performing, by the assistance engine, a second OCR process on the second set of images to generate a second content evaluation related to the segment of text;
• generating, by the assistance engine, a auditory response based on the second content evaluation;
• and
• playing, by the head-mounted device, the auditory response to the user.