Guiding a robotic surgical system to perform a surgical procedure

A method of guiding a robotic endoscope in a system including the robotic endoscope, the method comprising:

• identifying a region of interest of an affected body part of a subject patient;
• creating distance-based rules for the region of interest for generating alerts during a surgical procedure;
• endoscope image referencing by displaying a point of view (PoV) composite image using PoV real images of the subject patient captured by the robotic endoscope along with PoV augmented reality (AR) anatomical images of the region of interest based on a PoV of the robotic endoscope, wherein the robotic endoscope includes a plurality of cameras provided around a periphery of a head of the robotic endoscope having an orientation and direction to provide a front PoV of the robotic endoscope such that all of the plurality of cameras capture PoV real images that are integrated together to produce the PoV composite image of the robotic endoscope;
• wherein the distance-based rules further include displaying, during the endoscope image referencing, distances from the affected body part, as a function of speed of the endoscope, and
• wherein the endoscope image referencing includes:
• inserting the robotic endoscope into the subject patient, guiding the robotic endoscope using an interface for accepting an input for guiding the robotic endoscope for interacting with the system based on the displayed PoV composite image and the AR anatomical images,
• updating the displayed PoV composite image and the AR anatomical images based on a change in a viewing angle of the robotic endoscope, and
• guiding the robotic endoscope based on a position and a direction of a virtual version of the robotic endoscope relative to the updated displayed PoV composite image and the AR anatomical images,
• wherein the interface is a command line interface, a graphical user interface, or a voice interface for guiding the robotic endoscope.