Autonomous robot scenario re-simulation

A system for simulating robot behavior comprising at least one processor configured to execute instructions stored on a non-transitory computer-readable storage medium that, when executed, cause the system to perform steps comprising:

• instantiating, for a client, a virtual environment and a robot within the virtual environment;
• executing a robot simulation session in which the robot is autonomously controlled by the client;
• detecting, during a portion of the robot simulation session in which the robot is autonomously controlled, an intervention by a human operator to manually control the robot;
• identifying an intervention simulation time corresponding to the detected intervention;
• identifying a set of conditions of the virtual environment and the robot corresponding to an updated simulation starting time, the updated simulation starting time comprising a threshold amount of time before the intervention simulation time, the threshold amount of time selected based on one or more of a location of the robot at the intervention simulation time or the speed of the robot at the intervention simulation time;
• and
• executing an updated robot simulation session, the updated robot simulation session based on the identified set of conditions, the updated robot simulation session configured to begin at the updated simulation starting time.

A non-transitory computer-readable storage medium storing executable instructions that, when executed by a processor, cause steps to be performed comprising:

• instantiating, by a cloud server for a client, a virtual environment and a robot within the virtual environment;
• executing, by the cloud server, a robot simulation session in which the robot is autonomously controlled by the client;
• detecting, by the cloud server during a portion of the robot simulation session in which the robot is autonomously controlled, an intervention by a human operator to manually control the robot;
• identifying, by the cloud server, an intervention simulation time corresponding to the detected intervention;
• identifying, by the cloud server, a set of conditions of the virtual environment and the robot corresponding to an updated simulation starting time, the updated simulation starting time comprising a threshold amount of time before the intervention simulation time, the threshold amount of time selected based on one or more of a location of the robot at the intervention simulation time or the speed of the robot at the intervention simulation time;
• and
• executing, by the cloud server, an updated robot simulation session, the updated robot simulation session based on the identified set of conditions, the updated robot simulation session configured to begin at the updated simulation starting time.