Mobile virtual reality system for surgical robotic systems

A method for providing an immersive mobile interface for simulation and teleoperation of a surgical robotic system, the method comprising:

• receiving, by a head-worn device that is being worn by a user, a first video stream that comprises a virtual surgical robot within a virtual environment;
• receiving, by the head-worn device, a second video stream that comprises a view of a portion of the user's body;
• and
• displaying, on a display of the head-worn device, a first view section that comprises the first video stream and a second view section that comprises the second video stream.

A head-worn device comprising:

• a display;
• one or more processors;
• and
• memory having stored therein instructions which when executed by the one or more processors causes the head-worn device to receive, during a simulation or a teleoperation of a surgical robotic operating procedure and while the head-worn device is worn by a user, a video stream that comprises a virtual surgical robot within a virtual environment,
• wherein the display includes a first view section that comprises a rendering of the video stream and a second view section that comprises a view of a foot or a hand of a user of the head-worn device.