# US 2024/0203564 A1 · Decision support system for medical therapy planning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203564 A1
- Document ID: US20240203564A1
- Status: Published application
- Kind: A1
- Application number: 18/592,972
- Filed: 2024-03-01
- Published: 2024-06-20
- Earliest claimed: 2018-05-30
- Assignees: Siemens Healthineers AG
- Applicants: Siemens Healthineers AG
- Inventors: Ali Kamen; Bin Lou
- Web page: https://patentgrep.com/patent/US20240203564A1

## CPC

- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 5/7267: {involving training the classification device}
- A61N 5/103: {Treatment planning systems}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0475: Generative networks
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 3/096: Transfer learning
- G06T 7/0012: {Biomedical image inspection}
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- A61B 6/032: {Transmission computed tomography [CT]}
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

For decision support in a medical therapy, machine learning provides a machine-learned generator for generating a prediction of outcome for therapy personalized to a patient. Deep learning may result in features more predictive of outcome than handcrafted features. More comprehensive learning may be provided by using multi-task learning where one of the tasks (e.g., segmentation, non-image data, and/or feature extraction) is unsupervised and/or draws on a greater number of training samples than available for outcome prediction alone.

## Claims

### Claim 1

A method for decision support in a medical therapy system, the method comprising:
acquiring a medical scan of a patient;
generating a prediction of outcome of therapy for the patient, the outcome generated by a machine-learned multi-task generator having been trained based on a segmentation loss and an outcome loss; and
displaying an image of the outcome.

### Claim 2 (depends on 1)

The method of claim 1 wherein acquiring comprises scanning the patient with a computed tomography scanner.

### Claim 3 (depends on 1)

The method of claim 1 wherein acquiring comprises acquiring voxel data representing a three-dimensional distribution of locations in a volume of the patient, and wherein generating comprises generating based on input of the voxel data.

### Claim 4 (depends on 1)

The method of claim 1 wherein generating comprises generating with the machine-learned multi-task generator comprises a convolutional neural network.

### Claim 5 (depends on 4)

The method of claim 4 wherein generating comprises generating with the convolutional neural network comprising an encoder network trained as part of an encoder and decoder network, and the convolutional neural network comprising a neural network configured to receive bottleneck features of the encoder network, the neural network generating the outcome.

### Claim 6 (depends on 1)

The method of claim 1 wherein generating comprises generating with the machine-learned multi-task generator having been trained with deep learning to create segmentations compared to ground truth segmentation for the segmentation loss and to compare prediction results to ground truth results for the outcome loss.

### Claim 7 (depends on 1)

The method of claim 1 wherein generating comprises generating with the machine-learned multi-task generator having been trained with a greater number of training data samples for a segmentation loss than for the outcome loss.

### Claim 8 (depends on 1)

The method of claim 1 wherein generating comprises generating in response to input of non-image data for the patient to the machine-learned multi-task generator, the machine-learned multi-task generator comprising an autoencoder.

### Claim 9 (depends on 1)

The method of claim 1 wherein generating comprises generating with the machine-learned multi-task generator having been selected from a group of trained networks, each of the trained networks corresponding to different combinations of types of input data.

### Claim 10

A method for decision support in a medical therapy system, the method comprising:
acquiring first non-image data representing characteristics of a patient;
generating a prediction of outcome of therapy for the patient in response to input of the first non-image data, the outcome generated by a machine-learned network having been trained as an autoencoder for generating second non-image data representing patients from third non-image data representing other patients, the second non-image data of a same type as the third non-image data; and
displaying an image of the outcome.

### Claim 11 (depends on 10)

The method of claim 10 wherein acquiring the first non-image data comprises acquiring genomic, clinical, measurement, and/or family history data of the patient, and wherein the third non-image data comprise genomic, clinical, measurement, and/or family history data of the other patients.

### Claim 12 (depends on 10)

The method of claim 10 wherein generating comprises generating with the autoencoder comprising an encoder network trained as part of an encoder and decoder network, and a fully connected network configured to receive bottleneck features of the encoder network, the fully connected network generating the outcome.

### Claim 13 (depends on 10)

The method of claim 10 wherein generating comprises generating with the machine-learned network having been trained with multi-task deep learning to create segmentations compared to ground truth segmentation for the segmentation loss and to create outcome predictions compared to ground truth results for the outcome loss.

### Claim 14 (depends on 10)

The method of claim 10 wherein generating comprises generating with the machine-learned network having been selected from a group of trained networks, each of the trained networks corresponding to different combinations of types of input data.

### Claim 15

A method for machine training decision support in a medical therapy system, the method comprising:
defining a machine-training architecture with a plurality of data input options, each data input option corresponding to a different type of data;
machine training the machine-training architecture with different combinations of one or more of the data input options, the machine training with the different combinations resulting in different machine-trained generators configured to generate an output prediction for therapy;
determining performance of each of the machine-trained generators;
selecting one of the machine-trained generators based on the performance; and
storing the selected machine-trained generator.

### Claim 16 (depends on 15)

The method of claim 15 wherein machine training comprises machine training as a multi-task operation with a loss function comprising a weighted combination of an image feature loss and an outcome loss.

### Claim 17 (depends on 15)

The method of claim 15 wherein defining comprises defining the machine-training architecture as an autoencoder where the data input options comprise non-image data and as a neural network configured to receive bottleneck features from the autoencoder, the neural network trained to generate the prediction.

### Claim 18 (depends on 15)

The method of claim 15 wherein defining comprises defining with the different types of data comprising image data cropped to tumors, a therapy dose map, image data in which the tumors are less than half a represented region, demographic data, and clinical data.
