Operation Management System Utilizing a Wearable Device

A device, comprising:

• one or more memories;
• and
• one or more processors, communicatively coupled to the one or more memories, configured to:
• receive a video stream from a wearable device associated with a user;
• determine that the video stream is associated with the user performing an operation in a physical environment;
• determine, using an operation performance model, a state of a performance of the operation by the user, by processing a set of frames of the video stream that depicts the state of the performance of the operation by the user;
• determine, based on the state of the performance by the user, a next task of the operation;
• identify, using the operation performance model, a physical object depicted in the set of frames that is associated with the next task;
• generate display data that is associated with the physical object and performance of the next task of the operation;
• and
• provide the display data to the wearable device.

A wearable device comprising:

• a camera;
• a display device;
• and
• a controller that is configured to:
• receive, from the camera, a video stream that depicts a user performing an operation;
• process, using an operation performance model, a set of frames of the video stream that indicates a state of a performance of the operation by the user;
• determine, based on the state of the performance by the user, a next task of the operation;
• obtain task information associated with performance of the next task of the operation;
• and
• cause, based on the task information, the display device to present instructional information associated with facilitating performance of the next task of the operation, wherein
• the operation performance model is trained based on a plurality of historical videos indicative of historical performances of the operation by other users.