# US 2026/0090858 A1 · Monitoring of user visual gaze to control which display system displays the primary information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0090858 A1
- Document ID: US20260090858A1
- Status: Published application
- Kind: A1
- Application number: 19/389,159
- Filed: 2025-11-14
- Published: 2026-04-02
- Earliest claimed: 2020-10-02
- Assignees: Cilag GmbH International
- Applicants: Cilag GmbH International
- Inventors: Frederick E. Shelton, IV; Jason L. Harris
- Web page: https://patentgrep.com/patent/US20260090858A1

## CPC

- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/00045: {Display arrangement}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/60: for the operation of medical equipment or devices
- G16H 40/63: for local operation
- Y02A 90/10: Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02A: TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE

## Abstract

A surgical hub comprising a processor. The processor configured to perform a number of actions. A surgical task may that uses a medical instrument during a medical procedure may be determined based on contextual data. A technique employed by a user during the surgical task may be determined. A performance of the technique employed by the user relative to a baseline may be analyzed using the contextual data. A corrective action may be determined when the performance of the technique deviates from the baseline. A data priority based on the corrective action may be determined. A first message for a display may be generated based on the data priority. A second message for the medical instrument may be generated to cause an adjustment of one or more operational parameters when the performance of the technique deviates from the baseline.

## Claims

### Claim 1

A surgical hub for controlling a display, the surgical hub comprising:
a processor, the processor being configured to:
determine a surgical task that uses a medical instrument during a medical procedure based on contextual data;
determine a technique employed by a user during the surgical task;
analyze a performance of the technique employed by the user relative to a baseline using the contextual data;
determine a corrective action when the performance of the technique deviates from the baseline, wherein the corrective action improves the technique and a surgical outcome;
determine a data priority based on the corrective action, wherein the data priority adjusts a presentation of data preferred by the user by prioritizing information associated with the corrective action to improve the technique and improve the surgical outcome;
generate a first message for a display based on the data priority, wherein the first message comprises an instruction that causes the display to reconfigure presentation of the contextual data to prioritize information associated with the corrective action over the data preferred by the user;
generate a second message for the medical instrument to cause an adjustment of one or more operational parameters when the performance of the technique deviates from the baseline, wherein the adjustment improves operation of the medical instrument during the medical procedure; and
send the first message to the display and the second message to the medical instrument.

### Claim 2 (depends on 1)

The surgical hub of claim 1, wherein the corrective action improves the technique by reducing an error in a position or an orientation of the medical instrument when the position or the orientation exceeds a threshold during the medical procedure.

### Claim 3 (depends on 1)

The surgical hub of claim 1, wherein the corrective action comprises guidance to be shown on the display to guide the user to improve the technique or correct a surgical error.

### Claim 4 (depends on 1)

The surgical hub of claim 1, wherein the corrective action is determined based on an orientation of the medical instrument to compensate for the orientation during the medical procedure.

### Claim 5 (depends on 1)

The surgical hub of claim 1, wherein the instruction is a first instruction, and wherein the first message further comprises a second instruction that causes the display to adjust at least a color or spatial position of the contextual data to emphasize information associated with the corrective action.

### Claim 6 (depends on 1)

The surgical hub of claim 1, wherein the processor is configured to receive a command from the user, the command being at least one of a voice command, a gesture, or a tactile control command.

### Claim 7 (depends on 1)

The surgical hub of claim 1, wherein the adjustment of the one or more operational parameters comprises adjusting at least one of a closure force, a firing force, or an articulation angle of the medical instrument.

### Claim 8

A method performed by a surgical hub for controlling a display, the method comprising:
determining a surgical task that uses a medical instrument during a medical procedure based on contextual data;
determining a technique employed by a user during the surgical task;
analyzing a performance of the technique employed by the user relative to a baseline using the contextual data;
determining a corrective action when the performance of the technique deviates from the baseline, wherein the corrective action improves the technique and a surgical outcome;
determining a data priority based on the corrective action, wherein the data priority adjusts a presentation of data preferred by the user by prioritizing information associated with the corrective action to improve the technique and improve the surgical outcome;
generating a first message for a display based on the data priority, wherein the first message comprises an instruction that causes the display to reconfigure presentation of the contextual data to prioritize information associated with the corrective action over the data preferred by the user;
generating a second message for the medical instrument to cause an adjustment of one or more operational parameters when the performance of the technique deviates from the baseline, wherein the adjustment improves operation of the medical instrument during the medical procedure; and
sending the first message to the display and the second message to the medical instrument.

### Claim 9 (depends on 8)

The method of claim 8, wherein the corrective action improves the technique by reducing an error in a position or an orientation of the medical instrument when the position or the orientation exceeds a threshold during the medical procedure.

### Claim 10 (depends on 8)

The method of claim 8, wherein the corrective action comprises guidance to be shown on the display to guide the user to improve the technique or correct a surgical error.

### Claim 11 (depends on 8)

The method of claim 8, wherein the corrective action is determined based on an orientation of the medical instrument to compensate for the orientation during the medical procedure.

### Claim 12 (depends on 8)

The method of claim 8, wherein the instruction is a first instruction, and wherein the first message further comprises a second instruction that causes the display to adjust at least a color or spatial position of the contextual data to emphasize information associated with the corrective action.

### Claim 13 (depends on 8)

The method of claim 8, wherein the method further comprises receiving a command from the user, the command being at least one of a voice command, a gesture, or a tactile control command.

### Claim 14 (depends on 8)

The method of claim 8, wherein the adjustment of the one or more operational parameters comprises adjusting at least one of a closure force, a firing force, or an articulation angle of the medical instrument.

### Claim 15

A surgical hub for controlling a display, the surgical hub comprising:
a processor, the processor being configured to:
determine a technique employed by a user during a surgical task, wherein the technique is associated with a medical instrument;
analyze a performance of the technique employed by the user relative to a baseline;
determine a corrective action when the performance of the technique deviates from the baseline, wherein the corrective action improves the technique and a surgical outcome;
determine a data priority based on the corrective action, wherein the data priority adjusts a presentation of data preferred by the user by prioritizing information associated with the corrective action to improve the technique and improve the surgical outcome;
generate a first message for a display based on the data priority, wherein the first message comprises an instruction that causes the display to reconfigure presentation of contextual data to prioritize information associated with the corrective action over the data preferred by the user;
generate a second message for the medical instrument to cause an adjustment of one or more operational parameters when the performance of the technique deviates from the baseline, wherein the adjustment improves operation of the medical instrument during the surgical task; and
send the first message to the display and the second message to the medical instrument.

### Claim 16 (depends on 15)

The surgical hub of claim 15, wherein the corrective action improves the technique by reducing an error in a position or an orientation of the medical instrument when the position or the orientation exceeds a threshold during the medical procedure.

### Claim 17 (depends on 15)

The surgical hub of claim 15, wherein the corrective action comprises guidance to be shown on the display to guide the user to improve the technique or correct a surgical error.

### Claim 18 (depends on 15)

The surgical hub of claim 15, wherein the corrective action is determined based on an orientation of the medical instrument to compensate for the orientation during the surgical task.

### Claim 19 (depends on 15)

The surgical hub of claim 15, wherein the instruction is a first instruction, and wherein the first message further comprises a second instruction that causes the display to adjust at least a color or spatial position of the contextual data to emphasize information associated with the corrective action.

### Claim 20 (depends on 15)

The surgical hub of claim 15, wherein the processor is configured to receive a command from the user, the command being at least one of a voice command, a gesture, or a tactile control command.
