Mixed reality robotic training system and methods

A method for remote operation of a mixed reality robot training system, the robotic training system comprising a first computing device and a mixed reality device, the first computing device comprising a processor, a non-transitory computer readable medium having stored thereon instructions executable by the processor, a first program, and a first display, and wherein the mixed reality device comprises camera and a second display, the first computing device and the mixed reality device at a first location, the method comprising:

• receiving, by the first computing device, an input to command a simulated robot of the first program;
• determining, by the first computing device, a first instruction to control the operation of the simulated robot and a second instruction to control the operation of the mixed reality robot based on the input;
• controlling, by the first computing device, the operation of the simulated robot based on the first instruction and the operation of the mixed reality robot based on the second instruction;
• transmitting, by the first computing device, the second instructions to the mixed reality device to display the operation of the mixed reality robot in a scene of the second display.

A system comprising:

• a first computing device, the first computing device comprising:
• a processor,
• a non-transitory computer readable medium having stored thereon instructions executable by the processor,
• a first program, the first program comprising a user input interface, a simulated robot, and a mixed reality robot,
• a touchscreen display;
• and
• a mixed reality device, the mixed reality device comprising:
• camera,
• a second display;
• wherein the first computing device determines a first instruction to control the simulated robot based on at least one input at the user input interface;
• wherein the first computing device determines a second instruction to control the mixed reality robot based on the at least one input;
• wherein the first computing device transmits the second instruction to the mixed reality device to display the mixed reality robot on the second display.