# US 11,896,443 B2 · Control of a surgical system through a surgical barrier

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,896,443 B2
- Document ID: US11896443B2
- Status: Granted
- Kind: B2
- Application number: 16/182,232
- Filed: 2018-11-06
- Published: 2019-07-04
- Granted: 2024-02-13
- Earliest claimed: 2017-12-28
- Assignees: Cilag GmbH International
- Applicants: Cilag GmbH International
- Inventors: Frederick E. Shelton, IV; Jason L. Harris; Taylor W. Aronhalt
- Web page: https://patentgrep.com/patent/US11896443B2

## CPC

- A61B 90/37: {Surgical systems with images on a monitor during operation}
- A61B 17/072: for applying a row of staples in a single action, e.g. the staples being applied simultaneously
- A61B 17/320068: {using mechanical vibrations, e.g. ultrasonic (A61B17/22012 takes precedence; dental tooth drilling devices operated by vibration A61C3/03; removing intra-ocular material using mechanical vibrations A61F9/00745)}
- A61B 34/25: {User interfaces for surgical systems}
- A61B 42/10: Surgical gloves
- A61B 50/10: Furniture specially adapted for surgical or diagnostic appliances or instruments
- A61B 50/13: Trolleys{, e.g. carts}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 40/63: for local operation
- A61B 1/04: combined with photographic or television appliances
- A61B 5/02: Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B 17/320092: {with additional movable means for clamping or cutting tissue, e.g. with a pivoting jaw}
- A61B 18/1206: {Generators therefor}
- A61B 18/1442: {Probes having pivoting end effectors, e.g. forceps}
- A61B 18/1445: {at the distal end of a shaft, e.g. forceps or scissors at the end of a rigid rod}
- A61B 34/30: Surgical robots
- A61B 34/37: Leader-follower robots (A61B34/35 takes precedence)
- A61B 46/00: Surgical drapes
- A61B 90/90: Identification means for patients or instruments, e.g. tags
- A61B 90/92: coded with colour
- A61B 2017/00017: {Electrical control of surgical instruments}
- A61B 2017/00115: {with audible or visual output}
- A61B 2017/00199: {with a console, e.g. a control panel with a display}
- A61B 2017/00203: {with speech control or speech recognition}
- A61B 2017/00212: {using remote controls}
- A61B 2017/00221: {with wireless transmission of data, e.g. by infrared radiation or radiowaves}
- A61B 2017/00225: {Systems for controlling multiple different instruments, e.g. microsurgical systems}
- A61B 2017/00393: {with means for switching between functions}
- A61B 2017/00398: {using powered actuators, e.g. stepper motors, solenoids}
- A61B 2017/00442: {connectable to wrist or forearm}
- A61B 2018/00494: {Stomach, intestines or bowel}
- A61B 2018/00541: {Lung or bronchi}
- A61B 2018/00601: {Cutting}
- A61B 2018/0063: {Sealing}
- A61B 2018/00636: {Sensing and controlling the application of energy}
- A61B 2018/00994: {combining two or more different kinds of non-mechanical energy or combining one or more non-mechanical energies with ultrasound}
- A61B 2018/1253: {monopolar}
- A61B 2018/126: {bipolar}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2034/2063: {Acoustic tracking systems, e.g. using ultrasound}
- A61B 2050/185: {Drawers}
- A61B 2090/064: {for measuring force, pressure or mechanical tension}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B 2218/002: Irrigation
- A61B 2218/006: for smoke evacuation
- A61B 2218/007: Aspiration
- A61B 2218/008: for smoke evacuation
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A surgical system assembly is disclosed. The surgical system assembly includes a first surgical system and a second surgical system coupled to the first surgical system. The second surgical system includes a control circuit. The control circuit is configured to operate in a first mode or a second mode and control one or more functions of the first surgical system when the second surgical system is in the second mode.

## Claims

### Claim 1

A surgical system, comprising:
an image sensor;
a first device comprising a first control circuit and a display to display intraoperative images of a surgical site obtained by the image sensor; and
a second device configured to effect a surgical function, wherein the second device comprises a second control circuit in signal communication with the first control circuit, wherein the image sensor is positionable to image the second device such that an intraoperative image of the second device is viewable on the display of the first device, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the intraoperative image of the second device on the display is configured to interact with at least one icon on the display overlying intraoperative images of the surgical site on the display to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, and wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode.

### Claim 2 (depends on 1)

The surgical system of claim 1, wherein the second device comprises an end effector positioned within a sterile field, and wherein an image of the end effector is viewable on the display.

### Claim 3 (depends on 2)

The surgical system of claim 2, wherein the secondary operating mode comprises a cursor mode, and wherein the primary operating mode comprises a tissue treatment mode.

### Claim 4 (depends on 3)

The surgical system of claim 3, wherein the second control circuit is configured to toggle between the primary operating mode and the secondary operating mode in response to an audible command by a clinician.

### Claim 5 (depends on 1)

The surgical system of claim 1, wherein the second device is configured to provide an input to the first device to adjust information displayed on the display when the second device is in the secondary operating mode.

### Claim 6 (depends on 5)

The surgical system of claim 5, wherein the information displayed on the display is configured to be provided over an image of the surgical site.

### Claim 7 (depends on 1)

The surgical system of claim 1, wherein the display of the first device is configured to display an augmented reality view of the surgical site.

### Claim 8 (depends on 7)

The surgical system of claim 7, wherein the display is configured to depict a hidden anatomical structure when the display is displaying the augmented reality view of the surgical site.

### Claim 9

A surgical system, comprising:
a first device comprising a first control circuit and a display to display intraoperative images of a surgical site obtained by an image sensor; and
a second device configured to effect a surgical function, wherein the second device comprises a second control circuit in signal communication with the first control circuit, wherein an intraoperative image of a portion of the second device is viewable on the display, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the intraoperative image of the portion of the second device is configured to interact with at least one icon on the display overlying intraoperative images of the surgical site to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode, wherein the second device comprises a handle comprising an input switch movable between a first position and a second position, and wherein the first position corresponds to the primary operating mode and the second position corresponds to the secondary operating mode.

### Claim 10

A surgical system, comprising:
a first device comprising a first control circuit and a display to display intraoperative images of a surgical site obtained by an image sensor; and
a second device comprising an end effector configured to effect a surgical function within a sterile field, wherein the second device comprises a second control circuit in signal communication with the first control circuit, wherein an intraoperative image of the end effector is viewable on the display, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the intraoperative image of the end effector is configured to interact with at least one icon on the display overlying intraoperative images of the surgical site to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode, and wherein movement of the intraoperative image of the end effector within the sterile field is configured to drag and drop an icon across the display in the secondary operating mode.

### Claim 11

A surgical system, comprising:
a first device comprising a first control circuit and a display to display intraoperative images of a surgical site obtained by an image sensor; and
a second device comprising an end effector configured to effect a surgical function within a sterile field, wherein the second device comprises a second control circuit in signal communication with the first control circuit, wherein an intraoperative image of the end effector is viewable on the display, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the intraoperative image of the end effector is configured to interact with intraoperative images of the surgical site to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode, and wherein a movement of the intraoperative image of the end effector on the display is configured to select an anatomical feature on the display in the secondary operating mode from within the sterile field.

### Claim 12

A surgical system, comprising:
a first device comprising a first control circuit and a display; and
a second device configured to effect a surgical function, wherein the second device comprises a second control circuit in signal communication with the first control circuit, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the second device is configured to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode, wherein the second device comprises an ultrasonic instrument configured to apply ultrasonic vibrations to tissue, wherein the ultrasonic instrument comprises a first actuation button and a second actuation button, wherein, in the primary operating mode, the first actuation button is configured to actuate a first energy level and the second actuation button is configured to actuate a second energy level, and wherein, in the secondary operating mode, the first actuation button comprises a first cursor button and the second actuation button comprises a second cursor button.

### Claim 13

A surgical system, comprising:
an image sensor;
a first device comprising a first control circuit and a display; and
a second device configured to effect a surgical function, wherein the second device comprises an end effector and a second control circuit in signal communication with the first control circuit, wherein the image sensor is positionable to image the end effector at a surgical site such that an intraoperative image of the end effector and the surgical site are viewable on the display, wherein the second control circuit is configured to selectively toggle the second device between a secondary operating mode, in which the intraoperative image of the end effector is configured to interact with information on the display such that the second device is configured to control the first device, and a primary operating mode, in which the second device is configured to control the surgical function, wherein an ability of the second device to effect the surgical function is disabled when the second device is in the secondary operating mode, and wherein the second device comprises a handheld surgical instrument.

### Claim 14 (depends on 13)

The surgical system of claim 13, wherein the handheld surgical instrument comprises an ultrasonic instrument.

### Claim 15 (depends on 13)

The surgical system of claim 13, wherein the image sensor comprises a video camera, wherein the display is configured to present a play icon, and wherein the intraoperative image of the end effector is configured to interact with the play icon in the secondary operating mode to play video data obtained by the video camera.

### Claim 16 (depends on 13)

The surgical system of claim 13, wherein the image sensor comprises a video camera, wherein the display is configured to present a pause icon, and wherein the intraoperative image of the end effector is configured to interact with the pause icon in the secondary operating mode to pause a replaying of video data obtained by the video camera.

### Claim 17 (depends on 13)

The surgical system of claim 13, wherein the image sensor comprises a video camera, wherein the display is configured to present a rewind icon, and wherein the intraoperative image of the end effector is configured to interact with the rewind icon in the secondary operating mode to rewind video data obtained by the video camera.

### Claim 18 (depends on 13)

The surgical system of claim 13, wherein the image sensor comprises a video camera, wherein the display is configured to present a record icon, and wherein the intraoperative image of the end effector is configured to interact with the record icon in the secondary operating mode to record video data obtained by the video camera.