Guiding a robotic surgical system to perform a surgical procedure

A non-transitory computer-readable medium having executable instructions stored thereon that, when executed, cause one or more processors to:

• display a point of view (PoV) image of an affected area of a subject patient, using digital images from a plurality of front-facing cameras provided around a periphery of a drill bit of a robotic surgical drill, in a digital display, wherein a field of view of the plurality of cameras includes a PoV image region;
• create references in a Three-Dimensional (3D) space;
• display an augmented reality (AR) anatomical image or a virtual reality (VR) anatomical image, based on a viewing angle and the PoV region of the robotic surgical drill in the 3D space;
• guide the robotic surgical drill, remotely, based on guided movement of a virtual version of the robotic surgical drill on the displayed AR or VR anatomical image from movement of a hand-held guidance drill, the hand-held guidance drill being a same type of tool as the robotic surgical drill, wherein the robotic surgical drill tracks maneuvering of the hand-held guidance drill;
• update the displayed AR or VR anatomical image based on a change in the viewing angle and the PoV image region of the robotic surgical drill;
• and
• guide the robotic surgical drill based on a position and a direction of a guided movement of the virtual version of the robotic surgical drill on the updated displayed AR or VR anatomical image.

A system, comprising:

• a robotic surgical drill configured to capture a point of view (PoV) image of an affected anatomical area of a subject patient using a plurality of integrated cameras provided around a periphery of a drill bit of the robotic surgical drill, wherein a field of view of the plurality of cameras includes a PoV image region;
• a display to display, based on a viewing angle and the PoV image region of the robotic surgical drill, an augmented reality (AR) image or virtual reality (VR) image of the affected anatomical area of the subject patient;
• an interface to guide the robotic surgical drill, remotely, based on movement of a virtual version of the robotic surgical drill on the displayed AR or VR image of the affected anatomical area of the subject patient, wherein the interface comprises a hand-held guidance drill, the hand-held guidance drill being a same type of drill as the robotic surgical drill, wherein the robotic surgical drill that is able to be manipulated tracks maneuvering of the hand-held guidance drill;
• and
• an image database to store and update the AR or VR image of the affected anatomical area of the subject patient,
• wherein the interface updates guidance for the robotic surgical drill based on updates to the AR or VR image of the affected anatomical area of the subject patient retrieved from the image database.