# US 2015/0087957 A1 · Early therapy response assessment of lesions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0087957 A1
- Document ID: US20150087957A1
- Status: Published application
- Kind: A1
- Application number: 14/471,501
- Filed: 2014-08-28
- Published: 2015-03-26
- Earliest claimed: 2013-09-25
- Assignees: Siemens Aktiengesellschaft
- Applicants: Siemens Aktiengesellschaft
- Inventors: David Liu; Shaohua Kevin Zhou; Martin Kramer; Michael Sühling; Christian Tietjen; Grzegorz Soza; Andreas Wimmer
- Web page: https://patentgrep.com/patent/US20150087957A1

## CPC

- A61B 5/7267: {involving training the classification device}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data}
- A61B 6/5229: {combining image data of a patient, e.g. combining a functional image with an anatomical image}
- G06F 18/2134: based on separation criteria, e.g. independent component analysis
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 18/2155: {characterised by the incorporation of unlabelled data, e.g. multiple instance learning [MIL], semi-supervised techniques using expectation-maximisation [EM] or naïve labelling}
- G06T 7/0016: {involving temporal comparison}
- G06T 7/42: using transform domain methods
- G06V 10/76: {based on eigen-space representations, e.g. from pose or different illumination conditions; Shape manifolds}
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/7753: {Incorporation of unlabelled data, e.g. multiple instance learning [MIL]}
- A61B 5/4244: {liver}
- A61B 5/4848: {Monitoring or testing the effects of treatment, e.g. of medication}
- A61B 5/7275: {Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- G06T 2207/10072: Tomographic images
- G06T 2207/10136: 3D ultrasound image
- G06T 2207/20012: Locally adaptive
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T 2207/20064: Wavelet transform [DWT]
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/30056: Liver; Hepatic
- G06T 2207/30096: Tumor; Lesion
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

For therapy response assessment, texture features are input for machine learning a classifier and for using a machine learnt classifier. Rather than or in addition to using formula-based texture features, data driven texture features are derived from training images. Such data driven texture features are independent analysis features, such as features from independent subspace analysis. The texture features may be used to predict the outcome of therapy based on a few number of or even one scan of the patient.

## Claims

### Claim 1

A method for therapy response assessment, the method comprising:
obtaining a pre-therapy medical image of a patient, the pre-therapy medical image representing at least one lesion of the patient;
obtaining a post-therapy medical image of the patient, the post-therapy medical image of the patient representing the at least one lesion of the patient;
convolving, by a processor, the pre-therapy and post therapy medical images with a texture feature learned from training images; and
classifying, by the processor, a therapy response of the lesion with a machine-learnt classifier with a result of the convolving as an input feature to the machine-learnt classifier.

### Claim 2 (depends on 1)

The method of claim 1 wherein obtaining the pre-therapy and post therapy medical images comprises obtaining computed tomography images.

### Claim 3 (depends on 1)

The method of claim 1 wherein obtaining the post-therapy medical image comprises obtaining only the post-therapy medical image or only the post-therapy medical image and one more post therapy medical image, and wherein classifying comprises classifying with the input feature including, for just features from imaging, only features from the pre-therapy and post-therapy medical images.

### Claim 4 (depends on 1)

The method of claim 1 wherein convolving comprises convolving with the texture feature comprising an independent sub-space analysis feature.

### Claim 5 (depends on 1)

The method of claim 1 wherein convolving comprises convolving with the texture feature and at least two other texture features learned from the training images.

### Claim 6 (depends on 1)

The method of claim 1 wherein convolving comprises convolving with the texture feature learned automatically from the training images and labeled ground truths.

### Claim 7 (depends on 1)

The method of claim 1 wherein convolving comprises filtering with a kernel defined by the texture feature and summing intensities output from the filtering, the result being a function of the sum of the intensities.

### Claim 8 (depends on 1)

The method of claim 1 wherein convolving comprises convolving with the texture feature comprising a training image-based feature such that different training images result in different texture features.

### Claim 9 (depends on 1)

The method of claim 1 wherein classifying comprises classifying with a support vector machine or a regression random forest.

### Claim 10 (depends on 1)

The method of claim 1 wherein classifying comprises predicting an outcome of continuing therapy after obtaining the post-therapy medical image.

### Claim 11 (depends on 1)

The method of claim 1 wherein classifying comprises indicating a likelihood of therapy success or failure for the lesion.

### Claim 12 (depends on 1)

The method of claim 1 further comprising identifying regions of interest in the pre-therapy and post-therapy medical images including the lesion and a border of the lesion, and wherein convolving comprises convolving the texture feature with the regions of interest and not with regions outside the regions of interest.

### Claim 13 (depends on 1)

The method of claim 1 further comprising:
convolving, by the processor, the pre-therapy and post therapy medical images with mathematical formula-based texture features;
wherein classifying comprises classifying the therapy response with the result and results from the convolving with the mathematical formula-based textures features as an input vector including the input feature.

### Claim 14

In a non-transitory computer readable storage medium having stored therein data representing instructions executable by a programmed processor for therapy response assessment, the storage medium comprising instructions for:
with only one or two scans, extracting texture features for a lesion with a filter kernel, the filter kernel being independently based on image data; and
predicting an outcome of therapy on the lesion, the predicting being a function of the texture features.

### Claim 15 (depends on 14)

The non-transitory computer readable storage medium of claim 14 wherein extracting the texture features comprises convolving scan data of the one or two scans with the filter kernel and additional filter kernels, the filter kernel and additional filter kernels being developed from independent subspace analysis of the image data, the image data comprising training images.

### Claim 16 (depends on 14)

The non-transitory computer readable storage medium of claim 14 wherein predicting comprises predicting with a machine trained classifier without consideration of shrinkage of the lesion.

### Claim 17 (depends on 14)

The non-transitory computer readable storage medium of claim 14 further comprising outputting a likelihood of the outcome to a display.

### Claim 18

A method for therapy response assessment, the method comprising:
subjecting, by a processor, patches of lesions represented in a plurality of training frames of data to independent subspace analysis;
creating, by the processor, a number of image filters from the independent subspace analysis of the patches;
calculating, by the processor, texture features by application of the image filters to the lesions as represented in the training frames of data; and
learning, by the processor, a predictor of therapy response as a function of the texture features.

### Claim 19 (depends on 18)

The method of claim 18 further comprising whitening the patches with principle component analysis prior to the creating.

### Claim 20 (depends on 18)

The method of claim 18 wherein calculating the texture features comprises convolving the image filters with the lesions as represented in the training frames of data and averaging responses of the convolving, the averages comprising the texture features.
