# US 2024/0390068 A1 · Systems and methods for generating workspace geometry for an instrument

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0390068 A1
- Document ID: US20240390068A1
- Status: Published application
- Kind: A1
- Application number: 18/670,002
- Filed: 2024-05-21
- Published: 2024-11-28
- Earliest claimed: 2023-05-23
- Assignees: Intuitive Surgical Operations, Inc.
- Applicants: Intuitive Surgical Operations, Inc.
- Inventors: Steven Manuel; Daniel H. Gomez; Daniel N. Miller; John Ryan Steger; Prasad V. Upadrasta; Zhuoqun Xu; Chun hua Zheng; Pavel Chtcheprov
- Web page: https://patentgrep.com/patent/US20240390068A1

## CPC

- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 17/00234: {for minimally invasive surgery (A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence)}
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 34/25: {User interfaces for surgical systems}
- A61B 34/30: Surgical robots
- A61B 34/37: Leader-follower robots (A61B34/35 takes precedence)
- A61B 34/76: {Manipulators having means for providing feel, e.g. force or tactile feedback}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 2034/102: {Modelling of surgical devices, implants or prosthesis}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2034/301: {for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes}
- A61B 2034/302: {specifically adapted for manipulations within body cavities, e.g. within abdominal or thoracic cavities}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A computer-assisted system can comprise an instrument configured to be at least partially inserted through a body wall from an external workspace to an internal workspace within a body; and a controller configured to generate a first three-dimensional model of the internal workspace in which a first portion of the instrument is inserted during performance of a medical procedure using the instrument, generate a second three-dimensional model of an external workspace in which a second portion of the instrument is located during the performance of the medical procedure, based on the first three-dimensional model and the second three-dimensional model, determine an internal geometry within the internal workspace defining a reachable volume within the internal workspace within which the instrument may be positioned, and provide output related to performance of the medical procedure based on the determined internal geometry.

## Claims

### Claim 1

A computer-assisted system, comprising:
an instrument configured to be at least partially inserted through a body wall from an external workspace to an internal workspace within a body; and
a controller configured to:
generate a first three-dimensional model of the internal workspace in which a first portion of the instrument is inserted during performance of a medical procedure using the instrument,
generate a second three-dimensional model of an external workspace in which a second portion of the instrument is located during the performance of the medical procedure,
based on the first three-dimensional model and the second three-dimensional model, determine an internal geometry within the internal workspace defining a reachable volume within the internal workspace within which the instrument may be positioned, and
provide output related to performance of the medical procedure based on the determined internal geometry.

### Claim 2 (depends on 1)

The system of claim 1, further comprising a manipulator arm operatively coupled to the instrument and located in the external workspace, wherein the controller is further configured to control drive force transmission from the manipulator arm to the instrument.

### Claim 3 (depends on 2)

The system of claim 2, wherein the internal geometry includes an internal reach boundary, the internal reach boundary being a boundary defining a location of the first portion of the instrument within the internal workspace at which one or both of the instrument or manipulator arm contacts another object within the external workspace.

### Claim 4 (depends on 2)

The system of claim 2, wherein the controller is further configured to:
determine a location of an instrument within the internal workspace; and
display a repositioning request, the repositioning request including a visual indication to reposition the manipulator arm.

### Claim 5 (depends on 2)

The system of claim 2, wherein the controller is further configured to generate guidance for adjusting the manipulator arm to increase a size of the internal geometry.

### Claim 6 (depends on 1)

The system of claim 1, wherein the internal geometry is further determined based on one or both of a type of the medical procedure using the instrument or the stage of the medical procedure.

### Claim 7 (depends on 1)

The system of claim 1, wherein the controller is further configured to cause the system to:
determine a location of the instrument within the internal workspace, and provide a feedback to an operator of the instrument based on the location of the instrument.

### Claim 8 (depends on 7)

The system of claim 7, wherein the feedback includes a haptic feedback, a visual feedback, an audio feedback, or a combination thereof.

### Claim 9 (depends on 1)

The system of claim 1, wherein the controller is further configured to cause the system to:
determine a location of the instrument within the internal workspace, and
control actuation of the instrument based on the location of the instrument within the internal workspace.

### Claim 10 (depends on 1)

The system of claim 1, wherein the controller is further configured to cause the system to:
based on the first three-dimensional model and the second three-dimensional model, identify one or more locations on an external surface of the body for insertion of the instrument to access the internal workspace during the procedure.

### Claim 11 (depends on 1)

The system of claim 1, wherein the controller is further configured to:
receive internal three-dimensional image data of the internal workspace,
receive external three-dimensional image data of the external workspace, wherein a boundary is defined between the internal workspace and the external workspace and comprises an external surface portion of the body,
identify an external boundary locus based on the external three-dimensional image data,
define an internal boundary locus based on at least the identified external boundary locus and the internal three-dimensional image data, and
output information relating to the defined internal boundary locus.

### Claim 12 (depends on 11)

The system of claim 11, wherein the controller is further configured to cause the system to display the information relating to the defined internal boundary locus, and the information includes a partially-transparent graphical element corresponding to the internal boundary locus that is overlayed with a real-time image.

### Claim 13 (depends on 1)

The system of claim 1, wherein the controller is further configured to:
based on the first three-dimensional model and the second three-dimensional model, provide information relating to planning a positioning of the instrument during the procedure, and
update the first three-dimensional model based on an updated output of an image sensor.

### Claim 14

A computer-implemented method, comprising:
generating a first three-dimensional model of an internal workspace of a body in which a first portion of an instrument operatively coupled to a manipulator arm configured to transmit drive force to the instrument is inserted during performance of a procedure using the instrument;
generating a second three-dimensional model of an external workspace in which a second portion of the instrument is located during the performance of the procedure;
based on the first three-dimensional model and the second three-dimensional model, determining an internal geometry within the internal workspace defining a reachable volume within the internal workspace within which the instrument may be positioned by the manipulator arm; and
providing output related to performance of the procedure based on the determined internal geometry.

### Claim 15 (depends on 14)

The method of claim 14, wherein the internal geometry includes an internal reach boundary, the internal reach boundary being a boundary defining a location of the first portion of the instrument within the internal workspace at which one or both of the instrument or manipulator arm contacts another object within the external workspace.

### Claim 16 (depends on 14)

The method of claim 14, further comprising displaying the internal geometry, a representation of the first portion of the instrument within the internal workspace, or both to an operator of the instrument.

### Claim 17 (depends on 14)

The method of claim 14, further comprising:
determining a location of the instrument within the internal workspace, and
providing a feedback to an operator of the instrument based on the location of the instrument.

### Claim 18 (depends on 14)

The method of claim 14, further comprising:
determining a location of the instrument within the internal workspace, and
controlling actuation of the instrument based on the location of the instrument within the internal workspace.

### Claim 19 (depends on 14)

The method of claim 14, further comprising:
based on the first three-dimensional model and the second three-dimensional model, identifying one or more locations on an external surface of the body for insertion of the instrument to access the internal workspace during the procedure.

### Claim 20 (depends on 14)

The method of claim 14, further comprising:
receiving internal three-dimensional image data of the internal workspace,
receiving external three-dimensional image data of the external workspace, wherein a boundary is defined between the internal workspace and the external workspace and comprises an external surface portion of the body,
identifying an external boundary locus based on the external three-dimensional image data,
defining an internal boundary locus based on at least the identified external boundary locus and the internal three-dimensional image data, and
outputting information relating to the defined internal boundary locus.
