# US 2026/0090844 A1 · Extemporaneous route planning during live endoscopic surgical procedures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0090844 A1
- Document ID: US20260090844A1
- Status: Published application
- Kind: A1
- Application number: 19/413,576
- Filed: 2025-12-09
- Published: 2026-04-02
- Earliest claimed: 2023-02-01
- Assignees: The Penn State Research Foundation
- Applicants: The Penn State Research Foundation
- Inventors: William E. Higgins; Yuxuan He; Vahid Daneshpajooh; Qi Chang
- Web page: https://patentgrep.com/patent/US20260090844A1

## CPC

- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 34/25: {User interfaces for surgical systems}
- A61B 2017/00809: {Lung operations}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A methodology is for deriving a guidance route to any selected site including an unplanned ROI site observed in a radiologic imaging view or endoscopic video view on an assisted-endoscopy system during a live surgical endoscopic procedure based on a preloaded initial procedure plan. The initial procedure plan can be updated by identifying a new site s at the unplanned ROI on one of graphical visualization tools of an image-guided endoscope system as a new examination destination and automatically computing the new navigation airway route that leads to the new examination destination.

## Claims

### Claim 1

A method for automatically computing a new guidance route extemporaneously through a hollow organ system of a patient to a previously unplanned region of interest (ROI) observed during a live endoscopic procedure performed by a physician, the method comprising the steps of:
loading planning information computed offline prior to the live endoscopic procedure into a guidance system, the planning information representing the hollow organ system, centerlines within the organ system, and a preplanned guidance route leading to a preselected ROI, based on a three-dimensional (3D) radiologic image of the patient, wherein the centerlines consist of a set of directed paths pi, with each path pi consisting of a set of view sites visited once and only once along the path, originating at a beginning branch of the hollow organ system and terminating at a distal hollow organ branch;
loading image sources of the patient, the image sources including the 3D radiologic image, other 3D radiologic images, and endoscopic video generated during the live endoscopic procedure;
providing graphical tools constituting the guidance system's visual display, the graphical tools depicting various visualizations of the patient, based on the image sources;
navigating the endoscope to the preselected ROI along the preplanned guidance route;
identifying the previously unplanned ROI on one of the graphical tools of the visual display while navigating the endoscope to the preselected ROI;
automatically correlating a site of the previously unplanned ROI identified on the one of the graphical tools representing the previously unplanned ROI to the centerlines of the planning information to give a closest view site vc to the previously unplanned ROI;
automatically computing a new guidance route through the hollow organ system leading to the previously unplanned ROI, based on the closest view site vc, the previously unplanned ROI, planning information, and image sources, comprising the steps of:
i. selecting a path pi containing the view site vc among the set of directed paths;
ii. computing a new guidance route leading to the previously unplanned ROI, based on path pi; and
navigating the endoscope along the new guidance route through the hollow organ system to reach the previously unplanned ROI.

### Claim 2 (depends on 1)

The method according to claim 1, wherein each view site consists of a vector and an imaging camera's orientation during visualization along a path, the vector specifying coordinates and orientation angles;
the step of automatically computing the new guidance route leading to the previously unplanned ROI further comprising the steps of:
iii. deriving a compensation of ϵ view sites resulting in a new view site vs=vc-ϵ as an initial final view site for a preliminary guidance route ps leading to the previously unplanned ROI, the new view site vs preceding vc by ϵ view sites in the selected path pi, the preliminary guidance route ps meeting a constraint requirement;
iv. computing the vector z=s−vs for the previously unplanned ROI that starts at view site vs and points at the previously unplanned ROI, therefore obtaining a final view site vf for the preliminary guidance route ps; and
v. replacing vs with the final view site of in the preliminary guidance route ps, thereby providing the new guidance route leading to the previously unplanned ROI.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the image sources are a chest computed tomography (CT) scan, positron emission tomography (PET) scan, magnetic resonance imaging (MRI) scan, white-light bronchoscopic video, convex-probe endobronchial ultrasound video, radial-probe endobronchial ultrasound video, autofluorescence bronchoscopy video, or narrow-band imaging bronchoscopy video.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the previously unplanned ROI is identified on a 2D CT section, a fused 2D CT/PET section, a sliding thin-slab view, an endoluminal renderer, a 2D MRI section, a 2D projection view, a tube view, or a video frame of an endoscopic video stream.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the previously unplanned ROI is identified prior to the onset of the live endoscopic procedure or during the live endoscopic procedure.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising guiding use of a second supplemental device to navigate the new guidance route.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the second supplemental device is selected from an optical coherence tomography probe, a cryotherapy probe, a convex endobronchial ultrasound probe, a radial endobronchial ultrasound probe, or a neodymium-doped yttrium aluminum garnet (Nd:Yag) laser probe.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising previewing the new guidance route using the graphical tools of the guidance system prior to guiding the endoscope along the new guidance route.

### Claim 9 (depends on 1)

The method according to claim 1, further comprising saving any previously unplanned ROI and associated guidance route as part of a patient case study for future reference.

### Claim 10 (depends on 1)

The method according to claim 1, further comprising computing a distance needed to travel from a view site on the guidance route to the previously unplanned ROI.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the constraint requirement includes airway dimensions and a requirement that a tip of the endoscope must be able to fit through the airways.

### Claim 12 (depends on 1)

The method according to claim 1, wherein the endoscope is a bronchoscope, colonoscope, laparoscope, or cystoscope.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the hollow organ system includes the lung airways or hollow areas in the colon, stomach, bladder, or pelvis/abdomen.

### Claim 14 (depends on 1)

The method according to claim 1, where the live endoscopic procedure is performed by a robotics system.

### Claim 15

A system for computing a new guidance route extemporaneously through a hollow organ system of a patient to a previously unplanned region of interest (ROI), comprising:
a guidance system, comprising:
an endoscope operative to navigate within the hollow organ system;
a display device operative to display various graphical visualization tools depicting 2D computed tomography/positron emission tomography (CT/PET) sections, a sliding thin-slab view, an endoluminal renderer, a 2D projection view, a tube view, a global 3D hollow organ rendering, or real-time video streams of the endoscope;
a memory storing a procedure plan and updates to the procedure plan;
a processor in communication with the memory and the display device, the processor being operative to perform the steps of:
loading planning information previously computed offline prior to a live endoscopic procedure into a guidance system, the planning information representing the hollow organ system, centerlines within the hollow organ system, and a guidance route leading to a preselected ROI, based on a three-dimensional (3D) radiologic imaging data of the patient, wherein the centerlines consist of a set of directed paths pi, with each path pi consisting of a set of view sites visited once and only once along the path, originating at the beginning branch of the hollow organ system and terminating at a distal hollow organ branch;
automatically computing a new guidance route that leads to the previously unplanned ROI observed during the live endoscopic procedure on the display device, comprising the steps of:
i. finding a view site vc closest to the previously unplanned ROI;
ii. selecting a path pi containing the view site vc among the set of directed paths;
iii. computing a new guidance route leading to the previously unplanned ROI, based on path pi; and
guiding the endoscope along the new guidance route through the hollow organ system to reach unplanned ROI.

### Claim 16 (depends on 15)

The system of claim 15, wherein each view site consisting of a vector and an imaging camera's orientation during visualization along the path, the vector specifying coordinates and orientation angles;
the step of automatically computing the new guidance route leading to the previously unplanned ROI further comprising the steps of:
iv. deriving a compensation of ϵ view sites resulting in a new view site vs=vc-ϵ as an initial final view site for a preliminary guidance route ps leading to the previously unplanned ROI, the new view site vs preceding vc by ϵ view sites in the selected path pi, the preliminary guidance route ps meeting a constraint requirement;
v. computing the vector z=s−vs for the previously unplanned ROI that starts at view site vs and points at the previously unplanned ROI, therefore obtaining a final view site vf for the preliminary guidance route ps; and
vi. replacing vs with the final view site vf in the preliminary guidance route ps, thereby providing the new guidance route leading to the previously unplanned ROI.

### Claim 17 (depends on 15)

The system according to claim 15, wherein the previously unplanned ROI is identified on a 2D computed tomography (CT) section, a fused 2D CT/PET section, a sliding thin-slab view, an endoluminal renderer, a 2D MRI section, a 2D projection view, a tube view, or a video frame of an endoscopic video stream.

### Claim 18 (depends on 15)

The system according to claim 15, wherein the previously unplanned ROI is identified prior to the onset of the live endoscopic procedure or during the live endoscopic procedure.

### Claim 19 (depends on 15)

The system according to claim 15, wherein the processor is further operative to perform the steps of computing a distance needed to travel from a view site on the new guidance route to the previously unplanned ROI.

### Claim 20 (depends on 15)

The system according to claim 15, wherein the constraint requirement includes airway dimensions and a requirement that a tip of the endoscope must be able to fit through the airways.
