Remote operations using immersive telepresence

A system comprising:

• a computer processor;
• a virtual reality projector in communication with the computer processor;
• a set of physical robots comprising a tool and a plurality of cameras located on different parts of the set of physical robots, wherein:
• the different parts are separated by one or more distances between the plurality of cameras, and
• at least one of the set of physical robots and the tool is in communication with the computer processor;
• a user input device in communication with the computer processor;
• and
• a data repository in communication with the computer processor and storing:
• a plurality of images of a 3D space in which the set of physical robots is located, wherein the plurality of images are taken using at least two of the plurality of cameras,
• a parallax measurement established by the one or more distances, volumetric data of the 3D space, and
• a 3D virtual reality environment comprising a space representation of the 3D space, an object virtual representation of a physical object, and a robot virtual representation of the set of physical robots, wherein the robot virtual representation comprises a point-of-view located about on the set of physical robots.

A system comprising:

• a computer processor;
• a virtual reality projector in communication with the computer processor;
• a set of physical robots comprising a tool and a plurality of cameras located on different parts of the set of physical robots, wherein:
• the different parts are separated by one or more distances between the plurality of cameras, and
• at least one of the set of physical robots and the tool is in communication with the computer processor;
• a user input device in communication with the computer processor;
• and
• a non-transitory computer readable storage medium storing program code, which when executed by the computer processor, performs a computer-implemented method comprising:
• capturing, using at least two of the plurality of cameras, a plurality of images of a three-dimensional (3D) space;
• generating, using the at least two of the plurality of cameras and at least one parallax measurement established by the one or more distances, volumetric data of the 3D space;
• and
• generating, using the plurality of images and the volumetric data, a 3D virtual reality environment comprising a space representation of the 3D space, an object virtual representation of a physical object, and a robot virtual representation of the set of physical robots, wherein the robot virtual representation comprises a point-of-view located about on the set of physical robots.