# US 8,280,133 B2 · Method and system for brain tumor segmentation in 3D magnetic resonance images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,133 B2
- Document ID: US8280133B2
- Status: Granted
- Kind: B2
- Application number: 12/506,674
- Filed: 2009-07-21
- Published: 2010-02-04
- Granted: 2012-10-02
- Earliest claimed: 2008-08-01
- Assignees: Siemens Aktiengesellschaft
- Inventors: Michael Wels; Gustavo Henrique Monteiro de Barros Carneiro; Martin Huber; Dorin Comaniciu
- Web page: https://patentgrep.com/patent/US8280133B2

## CPC

- G06T 7/11: Region-based segmentation
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06F 18/295: {Markov models or related models, e.g. semi-Markov models; Markov random fields; Networks embedding Markov models}
- G06T 7/143: involving probabilistic approaches, e.g. Markov random field [MRF] modelling
- G06T 7/162: involving graph-based methods
- G06V 10/426: Graphical representations
- G06V 10/446: {using Haar-like filters, e.g. using integral image techniques}
- G06V 10/7747: {Organisation of the process, e.g. bagging or boosting}
- G06V 10/85: {Markov-related models; Markov random fields}
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/30016: Brain
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and system for brain tumor segmentation in multi-spectral 3D MRI images is disclosed. A trained probabilistic boosting tree (PBT) classifier is used to determine, for each voxel in a multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor. The brain tumor is then segmented in the multi-spectral 3D MRI image sequence using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence.

## Claims

### Claim 1

A method for brain tumor segmentation in a multi-spectral 3D magnetic resonance (MR) image sequence comprising a plurality of voxels, comprising:
determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor, using a trained probabilistic boosting tree (PBT) classifier; and
generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
pre-processing the multi-spectral 3D MR image prior to said determining step by:
performing skull stripping to remove skull image data in order to extract the brain in 3D MR images;
performing gradient anisotropic diffusion filtering; and
performing inter-scan intensity standardization.

### Claim 3 (depends on 1)

The method of claim 1, wherein said step of determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor, using a trained probabilistic boosting tree (PBT) classifier, comprises, for each voxel:
calculating local features for the voxel in a neighborhood of the voxel; and
determining the probability that the voxel is a brain tumor based on the local features calculated for the voxel.

### Claim 4 (depends on 3)

The method of claim 3, wherein said local features comprise at least one of individual multi-spectral intensities, inter-spectrality intensity gradients, 2D Haar-like features calculated on an intra-axial 2D context surrounding a voxel, and 3D Haar-like features calculated on a 3D context surrounding a voxel.

### Claim 5 (depends on 1)

The method of claim 1, wherein said step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
optimizing an objective function that integrates the probabilities determined using the trained PBT classifier and the intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 6 (depends on 5)

The method of claim 5, wherein the objective function comprises an observation model based on the probabilities determined using the trained PBT classifier and a spatial prior based on pair-wise homogeneity in classification labels and multi-spectral voxel intensities.

### Claim 7 (depends on 1)

The method of claim 1, wherein said step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
constraining a graph cuts optimization based on the probabilities determined using the trained PBT classifier.

### Claim 8 (depends on 1)

The method of claim 1, wherein said step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
generating a binary mask by optimizing an objective function based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence; and
generating the segmented brain tumor image by overlaying the binary mask on a 3D MR image of the multi-spectral 3D MR image sequence.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
removing false positive voxels from the segmented brain tumor image by retaining only a largest connected component of the segmented brain tumor image.

### Claim 10

An apparatus for brain tumor segmentation in a multi-spectral 3D magnetic resonance (MR) image sequence comprising a plurality of voxels, comprising:
means for determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor, using a trained probabilistic boosting tree (PBT) classifier; and
means for generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein said means for determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is a part of brain tumor, using a trained probabilistic boosting tree (PBT) classifier, comprises:
means for calculating local features for a voxel in a neighborhood of the voxel; and
means for determining the probability that the voxel is a brain tumor based on the local features calculated for the voxel.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein said local features comprise at least one of individual multi-spectral intensities, inter-spectrality intensity gradients, 2D Haar-like features calculated on an intra-axial 2D context surrounding a voxel, and 3D Haar-like features calculated on a 3D context surrounding a voxel.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein said means for generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
means for optimizing an objective function that integrates the probabilities determined using the trained PBT classifier and the intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the objective function comprises an observation model based on the probabilities determined using the trained PBT classifier and a spatial prior based on pair-wise homogeneity in classification labels and multi-spectral voxel intensities.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein said means for generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
means for constraining a graph cuts optimization based on the probabilities determined using the trained PBT classifier.

### Claim 16 (depends on 10)

The apparatus of claim 10, wherein said means for generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises:
means for generating a binary mask by optimizing an objective function based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence; and
means for generating the segmented brain tumor image by overlaying the binary mask on a 3D MR image of the multi-spectral 3D MR image sequence.

### Claim 17

A non-transitory computer readable medium encoded with computer executable instructions for brain tumor segmentation in a multi-spectral 3D magnetic resonance (MR) image sequence comprising a plurality of voxels, the computer executable instructions defining steps comprising:
determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor, using a trained probabilistic boosting tree (PBT) classifier; and
generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the computer executable instructions defining the step of determining, for each voxel in the multi-spectral 3D MR image sequence, a probability that the voxel is part of a brain tumor, using a trained probabilistic boosting tree (PBT) classifier, comprise computer executable instructions defining the steps of, for each voxel:
calculating local features for the voxel in a neighborhood of the voxel; and
determining the probability that the voxel is a brain tumor based on the local features calculated for the voxel.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein said local features comprise at least one of individual multi-spectral intensities, inter-spectrality intensity gradients, and 2D Haar-like features calculated on an intra-axial 2D context surrounding a voxel, and 3D Haar-like features calculated on a 3D context surrounding a voxel.

### Claim 20 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the computer executable instructions defining the step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises computer executable instructions defining the step of:
optimizing an objective function that integrates the probabilities determined using the trained PBT classifier and the intensities of the voxels in the multi-spectral 3D MR image sequence.

### Claim 21 (depends on 20)

The non-transitory computer readable medium of claim 20, wherein the objective function comprises an observation model based on the probabilities determined using the trained PBT classifier and a spatial prior based on pair-wise homogeneity in classification labels and multi-spectral voxel intensities.

### Claim 22 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the computer executable instructions defining the step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises computer executable instructions defining the step of:
constraining a graph cuts optimization based on the probabilities determined using the trained PBT classifier.

### Claim 23 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the computer executable instructions defining the step of generating a segmented brain tumor image using graph cuts segmentation based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence comprises computer executable instructions defining the steps of:
generating a binary mask by optimizing an objective function based on the probabilities determined using the trained PBT classifier and intensities of the voxels in the multi-spectral 3D MR image sequence; and
generating the segmented brain tumor image by overlaying the binary mask on a 3D MR image of the multi-spectral 3D MR image sequence.
