Systems and methods for presenting augmented reality in a display of a teleoperational system

A system comprising:

• a processor;
• and
• a memory having computer readable instructions stored thereon, the computer readable instructions, when executed by the processor, cause the system to:
• display a surgical environment image, wherein the surgical environment image includes a virtual marking element;
• display a body part of a user, the body part used to interact with the virtual marking element;
• receive a user input, via a gesture based input device registering movement of the body part of the user, while the body part interacts with the virtual marking element;
• generate a patient anatomy mark on a patient anatomy based on the received user input, wherein the virtual marking element indicates a potential incision location on the patient anatomy;
• and
• evaluate a feasibility of the potential incision location.

A system comprising:

• a processor;
• and
• a memory having computer readable instructions stored thereon, the computer readable instructions, when executed by the processor, cause the system to:
• display a first image on a display while a patient is located in a surgical environment, wherein the first image includes:
• an image of an internal patient anatomy received from a first imaging device,
• a virtual control element for controlling a component of a surgical system in the surgical environment, and
• a real-time image of the component of the surgical system;
• display a second image on the display while the patient is located in the surgical environment, wherein the second image includes an image of the surgical environment external of the internal patient anatomy received from a second imaging device, wherein the displayed first image is at least partially surrounded by the displayed second image;
• receive a gesture of a body part of a user in a predetermined motion, via a gesture based input device registering movement of the body part of the user, while the body part interacts with the virtual control element;
• and
• adjust a setting of the component of the surgical system based on the received gesture.