# US 2026/0083346 A1 · Determining position of medical device in branched anatomical structure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0083346 A1
- Document ID: US20260083346A1
- Status: Published application
- Kind: A1
- Application number: 19/376,502
- Filed: 2025-10-31
- Published: 2026-03-26
- Earliest claimed: 2020-12-29
- Assignees: Intuitive Surgical Operations, Inc.
- Applicants: Intuitive Surgical Operations, Inc.
- Inventors: Tao Zhao; Giuseppe Maria Prisco
- Web page: https://patentgrep.com/patent/US20260083346A1

## CPC

- A61B 1/009: {with bending or curvature detection of the insertion part}
- A61B 5/066: {Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/2676: {Bronchoscopes}
- A61B 5/0059: {using light, e.g. diagnosis by transillumination, diascopy, fluorescence (photoacoustic A61B5/0093; optical measurement of heart rate A61B5/02416; optical measurement of blood flow A61B5/0261; optical measurement of analytes A61B5/1455)}
- A61B 5/064: {using markers (A61B5/062 takes precedence)}
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- G06T 7/75: {involving models}
- A61B 6/12: Arrangements for detecting or locating foreign bodies
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 8/0841: {for locating instruments}
- A61B 8/5261: {combining images from different diagnostic modalities, e.g. ultrasound and X-ray}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10068: Endoscopic image
- G06T 2207/30004: Biomedical image processing
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Information extracted from sequential images captured from the perspective of a distal end of a medical device moving through an anatomical structure are compared with corresponding information extracted from a computer model of the anatomical structure. A most likely match between the information extracted from the sequential images and the corresponding information extracted from the computer model is then determined using probabilities associated with a set of potential matches so as to register the computer model of the anatomical structure to the medical device and thereby determine the lumen of the anatomical structure which the medical device is currently in. Sensor information may be used to limit the set of potential matches. Feature attributes associated with the sequence of images and the set of potential matches may be quantitatively compared as part of the determination of the most likely match.

## Claims

### Claim 1

A system comprising:
memory that stores information representing a model of an anatomical structure having a plurality of nodes defined by branches in the anatomical structure;
a medical device including a distal portion that is configured to be inserted into the anatomical structure, the distal portion supporting an image capturing device configured to capture images as the medical device is moved through branches of the anatomical structure,
one or more sensors configured to indicate a position of the medical device; and
one or more processing devices communicatively coupled to the memory and the medical device, the one or more processing devices configured to:
receive representations of sequential images captured using the image capturing device, wherein the sequential images are associated with a first node of the anatomical structure,
process the captured sequential images to determine a set of nodes from the plurality of nodes that potentially match the sequential images;
receive sensor data generated by the one or more sensors;
analyze the sensor data to identify a matching node of the set of nodes; and
determine a position of the medical device relative to the anatomical structure based on the identified matching node.

### Claim 2 (depends on 1)

The system of claim 1, wherein the one or more sensors include an insertion sensor configured to generate insertion data indicative of how much the medical device has been inserted into the anatomical structure.

### Claim 3 (depends on 2)

The system of claim 2, wherein to analyze the sensor data, the one or more processing devices are configured to:
identify nodes within a threshold distance of an insertion depth derived from the insertion data.

### Claim 4 (depends on 1)

The system of claim 1, wherein the one or more sensors include a position sensor within the medical device configured to provide position data.

### Claim 5 (depends on 4)

The system of claim 4, wherein to analyze the sensor data, the one or more processing devices are configured to:
identify nodes within a threshold distance of a position derived from the position data.

### Claim 6 (depends on 5)

The system of claim 5, wherein the threshold distance is an uncertainty range of the position sensor.

### Claim 7 (depends on 1)

The system of claim 1, wherein the one or more sensors additionally include an orientation sensor within the medical device configured to provide orientation information for the distal portion.

### Claim 8 (depends on 7)

The system of claim 7, wherein to analyze the sensor data, the one or more processing devices are configured to:
adjust an orientation of an object depicted in the sequential image data based on orientation information; and
identify nodes aligned with the adjusted orientation.

### Claim 9 (depends on 1)

The system of claim 1, wherein the one or more sensors additionally include a roll sensor configured to provide rotational data indicative of an amount the medical device has been rotated about a longitudinal axis.

### Claim 10 (depends on 9)

The system of claim 9, wherein to analyze the sensor data, the one or more processing devices are configured to:
estimate an orientation of the distal portion of the medical device based on the rotational data;
adjust an orientation of an object depicted in the sequential image data based on the estimated orientation; and
identify nodes aligned with the adjusted orientation.

### Claim 11 (depends on 1)

The system of claim 1, wherein the determined position includes a plurality of determined positions along a path traversed by the medical device when capturing the sequential images.

### Claim 12

A non-transitory computer-readable storage medium storing processor-executable instructions, that, when executed by one or more processors, cause the one or more processors to:
receive representations of sequential images captured using an image capturing device configured to capture images as a medical device is moved through branches of an anatomical structure, wherein the medical device includes a distal portion that is configured (i) to be inserted into the anatomical structure and (ii) to support the image capturing device, wherein the sequential images are associated with a first node of the anatomical structure,
process the captured sequential images to determine a set of nodes from a plurality of nodes defined by branches in a model of the anatomical structure, wherein the set of nodes potentially match the sequential images;
receive sensor data generated by one or more sensors configured to indicate a position of the medical device;
analyze the sensor data to identify a matching node of the set of nodes; and
determine a position of the medical device relative to the anatomical structure based on the identified matching node.

### Claim 13 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein the one or more sensors include an insertion sensor configured to generate insertion data indicative of how much the medical device has been inserted into the anatomical structure.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein to analyze the sensor data, the instructions, when executed, cause the one or more processors to:
identify nodes within a threshold distance of an insertion depth derived from the insertion data.

### Claim 15 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein the one or more sensors include a position sensor within the medical device configured to provide position data.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein to analyze the sensor data, the instructions, when executed, cause the one or more processors to:
identify nodes within a threshold distance of a position derived from the position data.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the threshold distance is an uncertainty range of the position sensor.

### Claim 18 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein:
the one or more sensors additionally include an orientation sensor within the medical device configured to provide orientation information for the distal portion; and
to analyze the sensor data, the instructions, when executed, cause the one or more processors to:
adjust an orientation of an object depicted in the sequential image data based on orientation information; and
identify nodes aligned with the adjusted orientation.

### Claim 19 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein:
the one or more sensors additionally include a roll sensor configured to provide rotational data indicative of an amount the medical device has been rotated about a longitudinal axis; and
to analyze the sensor data, the instructions, when executed, cause the one or more processors to:
estimate an orientation of the distal portion of the medical device based on the rotational data;
adjust an orientation of an object depicted in the sequential image data based on the estimated orientation; and
identify nodes aligned with the adjusted orientation.

### Claim 20 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein the determined position includes a plurality of determined positions along a path traversed by the medical device when capturing the sequential images.
