Manual operation of a remote robot assembly

A method for operating a remotely located robotic unit comprising:

• providing the remotely located robotic unit, comprising:
• a camera unit comprising at least one three-dimensional depth camera for capturing sensory information,
• wherein the sensory information comprises visual information;
• and
• at least one robotic arm;
• positioning the remotely located robotic unit proximate to an object;
• capturing, by the at least one three-dimensional depth camera, the visual information;
• responsive to receiving, at a control system, the visual information, creating a three-dimensional representation of the object based at least in part on the visual information;
• causing display of the visual information on a display associated with the control system;
• receiving, from a user associated with the control system, an instruction for the remotely located robotic unit to perform an action;
• wherein the instruction is received from a head-mounted controller or at least one hand-held controller capturing movement data of the user, and
• wherein the head-mounted controller controls the at least one three-dimensional depth camera and the at least one hand-held controller controls the at least one robotic arm;
• responsive to receiving the instruction, comparing the instruction to the three-dimensional representation;
• responsive to comparing the instruction to the three-dimensional representation, determining that there is an obstacle to performing the action;
• responsive to determining that there is the obstacle to performing the action, modifying the instruction;
• and
• causing the remotely located robotic unit to perform a modified action.

A method for operating a remotely located robotic unit comprising:

• providing the remotely located robotic unit, comprising:
• a movable camera mount;
• at least one camera to capture visual information and at least one three-dimensional camera for capturing three-dimensional depth information disposed on the movable camera mount;
• and
• at least one robotic arm;
• positioning the remotely located robotic unit proximate to an object;
• capturing sensory information from the at least one camera and the at least one three-dimensional camera,
• wherein the sensory information comprises the visual information and the three-dimensional depth information;
• receiving, at a control system, the sensory information;
• responsive to receiving the sensory information, creating a three-dimensional representation of the object based at least in part on the three-dimensional depth information;
• causing display of the visual information captured from the at least one camera on a display associated with the control system;
• receiving, from a first user associated with the control system, via a head-mounted controller or at least one hand-held controller capturing movement data of the first user, an instruction for the remotely located robotic unit to perform an action;
• wherein the head-mounted controller controls the movable camera mount and the at least one hand-held controller controls the at least one robotic arm;
• responsive to receiving an override instruction from a second user associated with the control system, overriding the instruction from the first user.