Multi-task learning-based myocardial segmentation and disease detection in cardiac mr tissue mapping images
AssigneeSiemens Healthineers AG
InventorsTeodora Marina Chitiboi, Andreea Bianca Popescu
Life of this patent
Estimating the term…
Abstract
Systems and methods for myocardial segmentation and disease detection using a multi-task deep learning model. The multi-task deep learning model simultaneously performs segmentation and disease detection using the interrelated aspects to improve both tasks. The multi-task deep learning model includes an encoder-decoder structure where a compressed representation extracted by an encoder of the encoder-decoder structure is used for both reconstructing a segmentation mask in the decoder and as an input for disease detection.
Claims20
A method for magnetic resonance (MR) image analysis, the method comprising:
- acquiring one or more MR images of a patient;
- applying a multi-task deep learning model to the one or more MR images, the multi-task deep learning model configured to simultaneously perform segmentation and disease detection, wherein the multi-task deep learning model comprises an encoder-decoder structure and a classification network, wherein a compressed representation extracted by an encoder of the encoder-decoder structure is used for reconstructing a segmentation mask by the decoder of the encoder-decoder structure and as an input for the classification network for a classification of one or more diseases;
- and
- outputting, by the multi-task deep learning model the segmentation mask and the classification.
A system for magnetic resonance (MR) image analysis, the system comprising:
- a medical imaging device configured to acquire a cardiac image of a patient;
- a memory configured to store a multi-task deep learning model configured to simultaneously perform segmentation and disease detection, wherein the multi-task deep learning model comprises an encoder-decoder structure and a classification network, wherein a latent space extracted by an encoder of the encoder-decoder structure is used for reconstructing one or more segmentation masks by the decoder of the encoder-decoder structure and as an input for the classification network for a classification of one or more diseases;
- and
- a processor configured to generate the one or more segmentation masks and the classification by inputting the cardiac image into the multi-task deep learning model.
A method for configuring a multi-task deep learning model, the method comprising:
- acquiring training data comprising a plurality of cardiac magnetic resonance (MR) images, related ground truth segmentation masks, and related ground truth disease classifications;
- inputting a cardiac MR image into the multi-task deep learning model, the multi-task deep learning model comprising a segmentation branch and a disease classification branch;
- outputting, by the multi-task deep learning model, a segmentation mask and a disease classification;
- adjusting weights of the segmentation branch based on a comparison of the segmentation mask to the related ground truth segmentation mask;
- adjusting weights of the disease classification branch based on a comparison of the disease classification to the related ground truth disease classification;
- repeating inputting, outputting, adjusting, and adjusting for a plurality of iterations;
- and
- outputting a trained multi-task deep learning model.
Dependencies are inferred from the claim text.