Multi-scale foundation model for predicting prostate cancer progression using longitudinal mri images

An apparatus comprising:

• means for receiving longitudinal medical images of an anatomical object of a patient acquired over a plurality of timepoints;
• for each respective timepoint of the plurality of timepoints:
• means for extracting features from the longitudinal medical images acquired at the respective timepoint using a machine learning based feature extractor network, and
• means for analyzing the anatomical object in the longitudinal medical images acquired at the respective timepoint based on the extracted features using a machine learning based prediction model;
• means for evaluating progression of the anatomical object over the plurality of timepoints based on results of the analyses using a machine learning based progression model;
• and
• means for outputting the evaluation of the progression of the anatomical object over the plurality of timepoints.

A non-transitory computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out operations comprising:

• receiving longitudinal medical images of an anatomical object of a patient acquired over a plurality of timepoints;
• for each respective timepoint of the plurality of timepoints:
• extracting features from the longitudinal medical images acquired at the respective timepoint using a machine learning based feature extractor network, and
• analyzing the anatomical object in the longitudinal medical images acquired at the respective timepoint based on the extracted features using a machine learning based prediction model;
• evaluating progression of the anatomical object over the plurality of timepoints based on results of the analyses using a machine learning based progression model;
• and
• outputting the evaluation of the progression of the anatomical object over the plurality of timepoints.