# US 2019/0318483 A1 · Apparatuses and methods for navigation in and local segmentation extension of anatomical treelike structures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318483 A1
- Document ID: US20190318483A1
- Status: Published application
- Kind: A1
- Application number: 15/952,189
- Filed: 2018-04-12
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Veran Medical Technologies, Inc.
- Applicants: Veran Medical Technologies, Inc.
- Inventors: Andrew DOUGHERTY; Mark HUNTER
- Web page: https://patentgrep.com/patent/US20190318483A1

## CPC

- G06T 7/187: involving region growing; involving region merging; involving connected component labelling
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/11: Region-based segmentation
- G06T 7/155: involving morphological operators
- G06T 7/162: involving graph-based methods
- G06T 7/215: Motion-based segmentation
- G06T 7/62: of area, perimeter, diameter or volume
- G06T 7/64: of convexity or concavity
- G06T 7/73: using feature-based methods
- G06T 15/08: Volume rendering
- G06T 17/005: {Tree description, e.g. octree, quadtree}
- G06T 2200/04: involving 3D image data
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10132: Ultrasound image
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20156: Automatic seed setting
- G06T 2207/30061: Lung
- G06T 2207/30064: Lung nodule
- G06T 2207/30096: Tumor; Lesion
- G06T 2207/30101: Blood vessel; Artery; Vein; Vascular
- G06T 2207/30172: Centreline of tubular or elongated structure
- G06T 2207/30204: Marker
- G06T 2207/30241: Trajectory
- G06T 2210/41: Medical
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A local extension method for segmentation of anatomical treelike structures includes receiving an initial segmentation of 3D image data including an initial treelike structure. A target point in the 3D image data is defined, and a region of interest based on the target point is extracted to create a sub-image. Highly tubular voxels are detected in the sub-image, and a spillage-constrained region growing is performed using the highly tubular voxels as seed points. Connected components are extracted from the results of the region growing. The extracted components are pruned to discard components not likely to be connected to the initial treelike structure, keeping only candidate components likely to be a valid sub-tree of the initial treelike structure. The candidate components are connected to the initial treelike structure, thereby extending the initial segmentation in the region of interest.

## Claims

### Claim 1

A local extension method for segmentation of anatomical treelike structures, the method comprising:
receiving an initial segmentation of 3D image data including an initial treelike structure;
defining a target point in the 3D image data;
extracting a region of interest based on the target point to create a sub-image;
detecting highly tubular voxels in the sub-image;
performing a spillage-constrained region growing using the highly tubular voxels as seed points;
extracting connected components from the region growing step;
pruning the extracted components to discard components not likely to be connected to the initial treelike structure and keep only candidate components likely to be a valid sub-tree of the initial treelike structure; and
connecting the candidate components to the initial treelike structure.

### Claim 2 (depends on 1)

The method of claim 1, wherein pruning comprises discarding components based on whether they have genus zero and are relatively convex.

### Claim 3 (depends on 2)

The method of claim 2, wherein discarding components comprises determining whether a ratio of a volume of the extracted component before morphological closing to a volume of the extracted component after morphological closing is greater than a threshold.

### Claim 4 (depends on 1)

The method of claim 1, wherein pruning comprises discarding or modifying components based on the components curving more than a threshold amount.

### Claim 5 (depends on 4)

The method of claim 4, wherein discarding components comprises determining whether a dot product of a direction of the extracted component and a direction of a segment of the extracted component is below a threshold.

### Claim 6 (depends on 1)

The method of claim 1, wherein pruning comprises discarding components based on a shape analysis of the shape of the extracted component.

### Claim 7 (depends on 6)

The method of claim 6, wherein discarding components comprises comparing shape analysis metrics including at least one of a minor axis length, an elongation, and an eccentricity of the extracted component to target metrics.

### Claim 8 (depends on 1)

The method of claim 1, wherein pruning comprises discarding components based on a cylindrical score of the components.

### Claim 9 (depends on 8)

The method of claim 8, wherein discarding components comprises determining a circle equivalent diameter of the extracted component.

### Claim 10 (depends on 1)

The method of claim 1, wherein pruning comprises iteratively evaluating image processing and geometric characteristics of each extracted component to determine whether the extracted component is a candidate component.

### Claim 11 (depends on 1)

The method of claim 1, wherein connecting comprises determining whether the candidate component has boundary voxels that are 4-connected to the initial segmentation and filling in voxels to fully connect the candidate component to the initial segmentation.

### Claim 12 (depends on 1)

The method of claim 1, wherein connecting comprises determining whether the radius of a candidate component is compatible with a terminal segment of the initial segmentation, and filling in voxels to connect the candidate component to the terminal segment if they are compatible.

### Claim 13 (depends on 1)

The method of claim 1, wherein connecting comprises determining if the candidate component includes a path of seed points to the initial segmentation.

### Claim 14 (depends on 13)

The method of claim 13, wherein if the candidate component includes the path of seed points, connecting further comprises identifying potential new growth based on a gradient ball method.

### Claim 15 (depends on 1)

The method of claim 1, further comprising creating a skeletonization of the initial segmentation and mask-labeling voxels in the initial segmentation according to the skeletonization.

### Claim 16 (depends on 1)

The method of claim 1, further comprising creating a skeletonization of the extracted components and mask-labeling voxels in the extracted components according to the skeletonization.

### Claim 17 (depends on 1)

The method of claim 1, further comprising smoothing the sub-image and enhancing the contrast in the sub-image.

### Claim 18

A method comprising:
receiving 3D image data;
segmenting an initial treelike structure in the 3D image data to create an initial segmentation;
creating a skeletonization of the initial segmentation;
mask-labeling voxels in the initial segmentation according to the skeletonization;
defining a target point in the initial segmentation;
extracting a region of interest based on the target point to create a sub-image;
smoothing the sub-image;
enhancing contrast in the sub-image;
detecting highly tubular voxels in the sub-image;
performing a spillage-constrained region growing using the highly tubular voxels as seed points;
extracting connected components from the region growing results;
creating a skeletonization of the extracted components;
mask-labeling voxels in the extracted components according to the skeletonization;
pruning the extracted components to discard components not likely to be connected to the initial treelike structure and keep only candidate components likely to be a valid sub-tree of the initial treelike structure; and
connecting the candidate components to the initial treelike structure.

### Claim 19 (depends on 19)

The method of claim 19, wherein pruning comprises:
discarding components based on whether they have genus zero and are relatively convex, including determining whether a ratio of a volume of the extracted component before morphological closing to a volume of the extracted component after morphological closing is greater than a threshold;
discarding or modifying components based on the components curving more than a threshold amount, including determining whether a dot product of a direction of the extracted component and a direction of a segment of the extracted component is below a threshold;
discarding components based on a shape analysis of the shape of the extracted component, including comparing shape analysis metrics including at least one of a minor axis length, an elongation, and an eccentricity of the extracted component to target metrics; and
discarding components based on a cylindrical score of the components, including determining a circle equivalent diameter of the extracted component.

### Claim 20 (depends on 18)

The method of claim 18, wherein connecting comprises:
determining whether the candidate component has boundary voxels that are 4-connected to the initial segmentation and if so filling in voxels to fully connect the candidate component to the initial segmentation;
determining whether the radius of a candidate component is compatible with a terminal segment of the initial segmentation, and filling in voxels to connect the candidate component to the terminal segment if they are compatible;
determining if the candidate component includes a path of seed points to the initial segmentation, and if so identifying potential new growth based on a gradient ball method.

### Claim at position 21

21-88. (canceled)
