# US 2021/0279884 A1 · Method of computing a boundary

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279884 A1
- Document ID: US20210279884A1
- Status: Published application
- Kind: A1
- Application number: 17/088,816
- Filed: 2020-11-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Siemens Healthcare GmbH
- Applicants: Siemens Healthcare GmbH
- Inventors: Noha El-Zehiry; Karim Amer; Mickael Sonni Albert Ibrahim Ide; Athira Jacob; Gareth Funka-Lea
- Web page: https://patentgrep.com/patent/US20210279884A1

## CPC

- G06T 7/12: Edge-based segmentation
- A61B 8/0883: {for diagnosis of the heart}
- A61B 8/14: Echotomography
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06T 7/0014: {using an image reference approach}
- G06T 7/13: Edge detection
- G06T 12/00: Tomographic reconstruction from projections
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/82: using neural networks
- G06V 30/19173: {Classification techniques}
- G06V 30/274: {Syntactic or semantic context, e.g. balancing}
- A61B 8/085: {for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10072: Tomographic images
- G06T 2207/10136: 3D ultrasound image
- G06T 2207/20041: Distance transform
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30048: Heart; Cardiac
- G06T 2207/30172: Centreline of tubular or elongated structure
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The disclosure relates to a method for determining a boundary about an area of interest in an image set. The includes obtaining the image set from an imaging modality and processing the image set in a convolutional neural network. The convolutional neural network is trained to perform the acts of predicting an inverse distance map for the actual boundary in the image set; and deriving the boundary from the inverse distance map. The disclosure also relates to a method of training a convolutional neural network for use in such a method, and a medical imaging arrangement.

## Claims

### Claim 1

A method of determining a boundary about an area of interest in an image set, the method comprising:
obtaining the image set from an imaging modality; and
processing the image set in a convolutional neural network,
wherein the convolutional neural network has been trained through: predicting an inverse distance map for an actual boundary in the image set; and deriving the boundary from the inverse distance map.

### Claim 2 (depends on 1)

The method of claim 1, wherein the deriving of the boundary from the predicted inverse distance map comprises thresholding the inverse distance map to obtain a binary boundary and subsequently extracting a medial axis of the binary boundary.

### Claim 3 (depends on 1)

The method of claim 1, wherein the boundary computed by the convolutional neural network is an open boundary or a closed surface boundary.

### Claim 4 (depends on 1)

The method of claim 1, wherein the convolutional neural network is configured to perform semantic image segmentation.

### Claim 5 (depends on 1)

The method of claim 1, wherein the convolutional neural network implements a U-Net architecture comprising four layers comprising encoder blocks and decoder blocks,
wherein each encoder block comprises a plurality of convolution filters, and
wherein each decoder block comprises a plurality of deconvolution filters.

### Claim 6 (depends on 5)

The method of claim 5, wherein the image set comprises a plurality of two-dimensional (2D) images,
wherein the inverse distance map is predicted for a two-dimensional surface boundary about an area of interest in a 2D image of the plurality of 2D images, and
wherein a two-dimensional boundary is inferred from the inverse distance map.

### Claim 7 (depends on 5)

The method of claim 5, wherein the image set comprises a three-dimensional (3D) image volume,
wherein the inverse distance map is predicted for a three-dimensional surface boundary about an area of interest in the 3D image volume, and
wherein a three-dimensional surface boundary is inferred from the inverse distance map.

### Claim 8 (depends on 7)

The method of claim 7, further comprising, prior to predicting the inverse distance map:
generating the 3D image volume from a plurality of image slices obtained from a 2D imaging modality.

### Claim 9 (depends on 1)

The method of claim 1, wherein the image set comprises a plurality of two-dimensional (2D) images,
wherein the inverse distance map is predicted for a two-dimensional surface boundary about an area of interest in a 2D image of the plurality of 2D images, and
wherein a two-dimensional boundary is inferred from the inverse distance map.

### Claim 10 (depends on 1)

The method of claim 1, wherein the image set comprises a three-dimensional (3D) image volume,
wherein the inverse distance map is predicted for a three-dimensional surface boundary about an area of interest in the 3D image volume, and
wherein a three-dimensional surface boundary is inferred from the inverse distance map.

### Claim 11 (depends on 10)

The method of claim 10, further comprising, prior to predicting the inverse distance map:
generating the 3D image volume from a plurality of image slices obtained from a 2D imaging modality.

### Claim 12 (depends on 1)

The method of claim 1, wherein the imaging modality is intracardiac echocardiography.

### Claim 13

A method of training a convolutional neural network for use in determining a boundary about an area of interest in an image set, the method comprising:
annotating an image set to identify a boundary about an area of interest;
replicating an inverse distance map of the boundary for use as a ground truth by the convolutional neural network;
applying the convolutional neural network to the image set and the ground truth to predict an inverse distance map approximating the ground truth; and
repeating the annotating, the replicating, and the applying until a desired level of accuracy has been achieved.

### Claim 14 (depends on 13)

The method of claim 13, wherein the replicating of the inverse distance map of the boundary is performed by blurring the boundary by a Gaussian function.

### Claim 15 (depends on 14)

The method of claim 14, wherein the convolutional neural network is configured to minimize a mean squared error between the ground truth and the predicted distance map.

### Claim 16 (depends on 13)

The method of claim 13, wherein the convolutional neural network is configured to minimize a mean squared error between the ground truth and the predicted distance map.

### Claim 17

A medical imaging arrangement comprising:
an imaging module configured to provide an image set;
a processing unit comprising a convolutional neural network loaded into a memory of the processing unit, wherein the processing unit is configured to obtain the image set from the imaging module and process the image set in the convolutional neural network, and wherein the convolutional neural network has been trained by predicting an inverse distance map for an actual boundary in the image set and deriving the boundary from the inverse distance map; and
a user interface configured to display the computed boundary in a context of the image set.
