# US 2025/0375247 A1 · Image guidance during cannulation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0375247 A1
- Document ID: US20250375247A1
- Status: Published application
- Kind: A1
- Application number: 19/307,683
- Filed: 2025-08-22
- Published: 2025-12-11
- Earliest claimed: 2021-10-20
- Assignees: Olympus Corporation
- Applicants: Olympus Corporation
- Inventors: Hiroyuki Mino; Hirokazu Horio; Brandon Ranalli; Mark Lavender; Gloria Yee; Anthony R. Pirozzi; Quinn C. Cartall; Atanaska Gospodinova; Katharina Dissmann
- Web page: https://patentgrep.com/patent/US20250375247A1

## CPC

- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 34/25: {User interfaces for surgical systems}
- A61B 1/000096: {using artificial intelligence}
- A61B 2017/00026: {Conductivity or impedance, e.g. of tissue}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- A61B 2090/367: {creating a 3D dataset from 2D images using position information}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

An endoscopic system can comprise an endoscope to be positioned and navigated in a patient anatomy, and a processor configured to reconstruct a three-dimensional (3D) image of an anatomical target based on at least two images of the anatomical target. The at least two images can be calibrated and registered using respective landmarks. One or more secondary images can be integrated with the reconstructed 3D image. The reconstructed image or the integrated image, along with the endoscope navigation plan, can be displayed to a user. Based on the reconstructed or the integrated image, the processor can generate an endoscope navigation plan for use in an image-guided endoscopic procedure.

## Claims

### Claim 1

An image-guided endoscopic system, comprising:
an endoscope configured to be positioned and navigated in a patient anatomy;
a display; and
a processor configured to:
receive at least two images of an anatomical target;
reconstruct a three-dimensional (3D) image of the anatomical target using the at least two received images;
generate an endoscope navigation plan for positioning and navigating the endoscope based at least on the reconstructed 3D image of the anatomical target;
control the display to automatically adjust at least one of a viewing area or a viewing angle of the display of the reconstructed 3D image in accordance with at least one of: i) the endoscope navigation plan or ii) a position or direction of a distal end of the endoscope relative to the anatomical target;
control a user input received via an input unit; and
control the display to automatically zoom in on a portion of the reconstructed 3D image as the distal portion of the endoscope gets closer to the anatomical target.

### Claim 2 (depends on 1)

The image-guided endoscopic system of claim 1, further comprising:
the input unit, wherein the input unit is configured to receive user input for controlling the viewing area and the viewing angle of the reconstructed 3D image.

### Claim 3 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the endoscope is configured to be positioned and navigated in a pancreaticobiliary system of the patient.

### Claim 4 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the endoscope includes an imaging sensor, and wherein the at least two received images include at least one endoscopic image of the anatomical target generated by the imaging sensor.

### Claim 5 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the at least two received images include at least one fluoroscopic image of the anatomical target.

### Claim 6 (depends on 1)

The image-guided endoscopic system of claim 1, wherein:
the at least two received images include at least one of at least one electrical potential map or an electrical impedance map of the anatomical target; and
the processor is configured to infer anatomical information from the electrical potential map or an electrical impedance map, and to reconstruct the 3D image of the anatomical target using the inferred anatomical information.

### Claim 7 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the at least two received images include first and second two-dimensional (2D) images.

### Claim 8 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the at least two received images include a first two-dimensional (2D) image and a second three-dimensional (3D) image.

### Claim 9 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the at least two received images include first and second three-dimensional (3D) images.

### Claim 10 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the at least two received images include images from different sources or with different modalities.

### Claim 11 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the processor is configured to:
receive one or more secondary images of the anatomical target generated by an imaging device other than the endoscope;
integrate the reconstructed 3D image with the one or more secondary images; and
generate the endoscope navigation plan based at least on the integrated reconstructed 3D image of the anatomical target.

### Claim 12 (depends on 11)

The image-guided endoscopic system of claim 11, wherein the secondary image includes one or more of:
a computer-tomography (CT) scan image;
a magnetic resonance imaging (MRI) scan image;
a magnetic resonance cholangiopancreatography (MRCP) image; or
an endoscopic ultrasonography (EUS) image.

### Claim 13 (depends on 11)

The image-guided endoscopic system of claim 11, wherein the processor is further configured to:
generate an integrated reconstructed 3D image by superimposing the reconstructed 3D image over the one or more secondary images.

### Claim 14 (depends on 11)

The image-guided endoscopic system of claim 11, wherein the processor is further configured to:
generate the integrated reconstructed 3D image by applying the reconstructed 3D image and the secondary image to a trained machine-learning model.

### Claim 15 (depends on 1)

The image-guided endoscopic system of claim 1, wherein to generate an endoscope navigation plan includes to automatically recognize the anatomical target, and automatically recognize the anatomical target, and to estimate one or more navigation parameters including:
a distance of an endoscope distal portion relative to an anatomical target;
a heading direction of the endoscope distal portion relative to the anatomical target;
an angle of cannula or a surgical element;
a protrusion amount of a cannula or a surgical element;
a speed or force applied to the endoscope distal portion or a surgical element;
a rotational direction or a cutting area of a surgical element; or
a projected navigation path toward the anatomical target.

### Claim 16 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the processor is configured to generate the endoscope navigation plan by applying the reconstructed 3D image to a trained machine-learning model, the trained machine-learning model being trained to establish a relationship between (i) one or more images or image features representing variants of the anatomical target, and (ii) one or more endoscope navigation plans for the variants of the anatomical target.

### Claim 17 (depends on 16)

The image-guided endoscopic system of claim 16, wherein the processor is configured to train the machine-learning model using a training dataset comprising procedure data from past endoscopic procedures on a plurality of patients, the procedure data including (i) one or more images of anatomical targets of the plurality of patients and (ii) one or more corresponding endoscope navigation plans.

### Claim 18 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the display is configured to adjust the display of the reconstructed 3D image according to the endoscope navigation plan.

### Claim 19 (depends on 18)

The image-guided endoscopic system of claim 18, wherein to adjust the display includes to automatically zoom a portion of the reconstructed 3D image based on a position or a direction of a distal portion of the endoscope relative to an anatomical target.

### Claim 20 (depends on 1)

The image-guided endoscopic system of claim 1, wherein the display is further configured to display one or more visual indications overlaid upon the reconstructed 3D image, the one or more visual indications including:
an anatomical target;
a projected navigation path toward the anatomical target; or
a progress of the endoscope advancing toward the anatomical target along the projected navigation path.
