Convolutional localization networks for intelligent captioning of medical images

A system for generating a textual description of a medical image, comprising:

• an image segmenting module configured to receive a medical image of an anatomical region, the image comprising one or more abnormalities, and further configured to segment the anatomical region in the received medical image from a remainder of the image;
• an abnormality identification module configured to identify at least one of the one or more abnormalities in the segmented anatomical region;
• a feature extraction module configured to extract one or more features from the identified abnormality using the DICOM tags;
• a text generation module configured to generate, using the extracted features and a trained text generation model, a textual description of the identified abnormality;
• and
• a user interface configured to report the generated textual description.