# US 2024/0390087 A1 · Systems and methods for constraining a virtual reality surgical system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0390087 A1
- Document ID: US20240390087A1
- Status: Published application
- Kind: A1
- Application number: 18/794,855
- Filed: 2024-08-05
- Published: 2024-11-28
- Earliest claimed: 2017-04-20
- Assignees: Intuitive Surgical Operations, Inc.
- Applicants: Intuitive Surgical Operations, Inc.
- Inventors: Henry C. Lin; May Quo-Mei Liu
- Web page: https://patentgrep.com/patent/US20240390087A1

## CPC

- A61B 34/35: for telesurgery
- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- A61B 90/50: Supports for surgical instruments, e.g. articulated arms
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- A61B 34/25: {User interfaces for surgical systems}
- A61B 34/30: Surgical robots
- A61B 2017/00216: {with eye tracking or head position tracking control}
- A61B 2017/00707: {Dummies, phantoms; Devices simulating patient or parts of patient}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B 2090/502: {Headgear, e.g. helmet, spectacles}
- G02B 27/017: {Head mounted}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A method of operating a surgical control system is provided. The method comprises displaying, on a display system, an image of a surgical environment. The display system is configured to move with a head of a user. The method further comprises detecting a manipulator input motion and determining if the manipulator input motion is within a boundary corresponding to a range of motion of a manipulator. The manipulator is coupled to a medical instrument and is configured to control motion of the medical instrument. The method further comprises enabling a virtual manipulator mode if the manipulator input motion exceeds the boundary.

## Claims

### Claim at position 1

1-28. (canceled)

### Claim 29

A method of operating a surgical control system, the method comprising:
displaying, on a display system, an image of a surgical environment, the display system configured to move with a head of a user;
detecting a manipulator input motion;
determining if the manipulator input motion is within a boundary corresponding to a range of motion of a manipulator, the manipulator coupled to a medical instrument and configured to control motion of the medical instrument; and
if the manipulator input motion exceeds the boundary, enabling a virtual manipulator mode.

### Claim 30 (depends on 29)

The method of claim 29, further comprising:
while the surgical control system is in the virtual manipulator mode, displaying, on the display system, a ghost image of the medical instrument.

### Claim 31 (depends on 30)

The method of claim 30, further comprising:
while the surgical control system is in the virtual manipulator mode and responsive to the manipulator input motion, displaying the ghost image of the medical instrument moving on the display system, wherein motion of the ghost image of the medical instrument corresponds to the detected manipulator input motion.

### Claim 32 (depends on 29)

The method of claim 29, further comprising:
while the surgical control system is in the virtual manipulator mode, displaying, on the display system, a ghost image of the manipulator.

### Claim 33 (depends on 32)

The method of claim 32, further comprising:
while the surgical control system is in the virtual manipulator mode and responsive to the manipulator input motion, displaying the ghost image of the manipulator moving on the display system, wherein motion of the ghost image of the manipulator corresponds to the detected manipulator input motion.

### Claim 34 (depends on 29)

The method of claim 29, further comprising:
disabling operation of the medical instrument in the surgical environment while the surgical control system is in the virtual manipulator mode.

### Claim 35 (depends on 29)

The method of claim 29, further comprising:
disabling operation of the manipulator in the surgical environment while the surgical control system is in the virtual manipulator mode.

### Claim 36 (depends on 29)

The method of claim 29, further comprising:
providing directions for exiting the virtual manipulator mode, wherein the directions guide a movement of a user to a position that matches a last position of the manipulator within the boundary corresponding to the range of motion of a manipulator.

### Claim 37 (depends on 36)

The method of claim 36, wherein the directions include audible directions.

### Claim 38 (depends on 36)

The method of claim 36, wherein the directions include visual images presented on the display system.

### Claim 39 (depends on 36)

The method of claim 36, further comprising:
providing an indication to the user that the surgical control system has exited the virtual manipulator mode.

### Claim 40 (depends on 29)

The method of claim 29, wherein detecting the manipulator input motion includes detecting a movement of an arm of the user.

### Claim 41 (depends on 29)

The method of claim 29, wherein detecting the manipulator input motion includes detecting a movement of a hand of the user.

### Claim 42 (depends on 29)

The method of claim 29, wherein the medical instrument is an imaging instrument.

### Claim 43

A medical system comprising:
a display configured to be mounted to a head of a user;
a manipulator coupled to a medical instrument and configured to control motion of the medical instrument; and
a control system configured to:
display, on the display, an image of a surgical environment;
detect a manipulator input motion;
determine if the manipulator input motion is within a boundary corresponding to a range of motion of the manipulator; and
if the manipulator input motion exceeds the boundary, enabling a virtual manipulator mode.

### Claim 44 (depends on 43)

The medical system of claim 43, wherein the control system is further configured to:
while the medical system is in the virtual manipulator mode, display, on the display, a ghost image of the manipulator.

### Claim 45 (depends on 44)

The medical system of claim 44, wherein the control system is further configured to:
while the medical system is in the virtual manipulator mode and responsive to the manipulator input motion, displaying the ghost image of the manipulator moving on the display, wherein motion of the ghost image of the manipulator corresponds to the detected manipulator input motion.

### Claim 46 (depends on 43)

The medical system of claim 43, wherein the control system is further configured to:
disable operation of the medical instrument in the surgical environment while the medical system is in the virtual manipulator mode.

### Claim 47 (depends on 43)

The medical system of claim 43, wherein the control system is further configured to:
disable operation of the manipulator in the surgical environment while the medical system is in the virtual manipulator mode.

### Claim 48 (depends on 43)

The medical system of claim 43, wherein the control system is further configured to:
provide directions for exiting the virtual manipulator mode, wherein the directions guide a movement of the user to a position that matches a last position of the manipulator within the boundary corresponding to the range of motion of a manipulator.
