Closed-loop control system for robotic operation

A system comprising:

• one or more robotic devices;
• and
• a computing device configured to:
• receive one or more sequences of operations corresponding to the one or more robotic devices within a workcell, wherein the one or more sequences of operations are synchronized to timestamps of a global timeline;
• provide instructions for display of a visual simulation of the one or more robotic devices to illustrate a portion of the one or more sequences of operations;
• provide instructions for display of a graphical timeline representing timestamps of a portion of the global timeline corresponding to the portion of the one or more sequences of operations;
• identify an error in robotic operation experienced during execution of the portion of the one or more sequences of operations, wherein the error comprises at least one of the one or more robotic devices exceeding an allowable range of motion;
• determine a timestamp of the global timeline at which the error has been experienced;
• provide instructions for display of a warning signal indicating the error at a timestamp of the graphical timeline representing the timestamp of the global timeline at which the error has been experienced;
• and
• provide instructions for display, within the visual simulation, of an end effector separated from the at least one of the one or more robotic devices by a distance proportional to an extent by which the allowable range of motion has been exceeded.

A non-transitory computer readable medium having stored therein instructions, that when executed by a computing system, cause the computing system to perform functions comprising:

• receiving, by a computing device, one or more sequences of operations corresponding to one or more robotic devices within a workcell, wherein the one or more sequences of operations are synchronized to timestamps of a global timeline;
• providing instructions for display of a visual simulation of the one or more robotic devices to illustrate a portion of the one or more sequences of operations;
• providing instructions for display of a graphical timeline representing timestamps of a portion of the global timeline corresponding to the portion of the one or more sequences of operations;
• identifying, by the computing device, an error in robotic operation predicted to occur during execution of the portion of the one or more sequences of operations, wherein the error comprises at least one of the one or more robotic devices exceeding an allowable range of motion;
• determining, by the computing device, a timestamp of the global timeline at which the error is predicted to occur;
• providing instructions for display of a warning signal indicating the error at a timestamp of the graphical timeline representing the timestamp of the global timeline at which the error is predicted to occur;
• and
• providing instructions for display, within the visual simulation, of an end effector separated from the at least one of the one or more robotic devices by a distance proportional to an extent by which the allowable range of motion is exceeded.