System for testing and training robot control

A system for training and testing a robot control module, the system comprising:

• a computation device configured to train and/or test a robot control module;
• a data collection device configured to collect data related one or more human-driven robot tasks that are to be performed by an operator performing robot action or movement;
• one or more sensing devices located in a location of the operator;
• and
• a mixed reality device that is worn by the operator, the system configured to perform the following:
• generate at the computation device an instruction specified by a robot control module configured for robot training and/or testing, the instruction indicating how a human-driven robot task is to be performed when training and/or testing the robot control module;
• provide the instruction to the mixed reality device worn by the operator, the mixed reality device rendering the instruction in a manner that shows the operator how to perform the human-driven robot task to perform robot action or movement;
• collect performance data and environmental data in response to the operator attempting to perform the human-driven robot task specified by the instruction using the data collection device, the collected performance data and the environmental data being collected by one or more of the data collection device and the one or more sensing devices;
• receive feedback data in response to the operator attempting to perform the human-driven robot task specified by the instruction using a data collection device;
• and
• update the robot control module using the feedback data and the collected performance and environmental data.