Processing videos based on temporal stages

One or more non-transitory computer-readable media storing instructions executable to perform operations for video processing, the operations comprising:

• identifying one or more actions from an instruction for completing a task;
• generating, by a first neural network, a chronological sequence of stages of the task by inputting the one or more actions into the first neural network, wherein the stages in the chronological sequence have a temporal order, and a completion of a stage preceding another stage according to the temporal order is a prerequisite for occurrence of the another stage;
• inputting a video into a first layer of a second neural network, the video illustrating an action performed to complete the task;
• inputting the chronological sequence of stages into a second layer of the second neural network, wherein the second layer is a hidden layer of the second neural network and is subsequent to the first layer in the second neural network;
• and
• classifying, by the second neural network, the action based on the video and the chronological sequence of stages.

An apparatus for video processing, the apparatus comprising:

• a computer processor for executing computer program instructions;
• and
• a non-transitory computer-readable memory storing computer program instructions executable by the computer processor to perform operations comprising:
• identifying one or more actions from an instruction for completing a task,
• generating, by a first neural network, a chronological sequence of stages of the task by inputting the one or more actions into the first neural network, wherein the stages in the chronological sequence have a temporal order, and a completion of a stage preceding another stage according to the temporal order is a prerequisite for occurrence of the another stage,
• inputting a video into a first layer of a second neural network, the video illustrating an action performed to complete the task,
• inputting the chronological sequence of stages into a second layer of the second neural network, wherein the second layer is a hidden layer of the second neural network and is subsequent to the first layer in the second neural network, and
• classifying, by the second neural network, the action based on the video and the chronological sequence of stages.