Systems and methods for customizing playback of digital tutorials

A method comprising:

• causing to be output a tutorial for a task, wherein the task comprises a plurality of states;
• causing to be captured, via a camera, image data of a current state of the task;
• detecting an utterance from a user;
• in response to detecting the utterance, determining that the utterance is related to the task;
• based on determining that the utterance is related to the task:
• determine, using a trained neural network, based on the image data, whether the current state of the task matches a target state of the task;
• in response to determining that the current state of the task does not match the target state of the task:
• pause output of the tutorial for the task;
• and
• cause to be output a recommendation to bring the current state of the task to the target state of the task;
• and
• in response to determining that the current state of the task matches the target state of the task, continue to output the tutorial for the task.

A system comprising:

• a camera;
• and
• control circuitry configured to:
• cause to be output a tutorial for a task, wherein the task comprises a plurality of states;
• cause to be captured, via the camera, image data of a current state of the task;
• detect an utterance from a user;
• in response to detecting the utterance, determine that the utterance is related to the task;
• based on determining that the utterance is related to the task:
• determine, using a trained neural network, based on the image data, whether the current state of the task matches a target state of the task;
• in response to determining that the current state of the task does not match the target state of the task:
• pause output of the tutorial for the task;
• and
• cause to be output a recommendation to bring the current state of the task to the target state of the task;
• and
• in response to determining that the current state of the task matches the target state of the task, continue to output the tutorial for the task.