System and method for sequencing assembly tasks

An apparatus, the apparatus comprising:

• a graphical user interface to present an image of a work scene comprising a plurality of components and to receive, from a user, a sequence of operation commands, wherein a respective operation command corresponds to a pixel location in the image;
• a computer-vision system to determine, for each operation command and based on the image, a task to be performed by a robotic system at a corresponding location in the work scene;
• a graph-construction unit to generate a directed graph based on the received sequence of operation commands and the image of the work scene, wherein each node in the directed graph corresponds to a task, and wherein each directed edge in the directed graph corresponds to a task-performing order;
• and
• a robotic controller;
• wherein the computer-vision system is further to capture images of a second work scene,
• wherein the graph-construction unit is further to reconstruct the directed graph for the second work scene based on the captured images, and
• wherein the robotic controller is to control the robotic system to perform a sequence of tasks at the second work scene based on the reconstructed directed graph.