Method and system for the computer-aided processing of medical images

A method of using a multimodal model for generation of radiology outputs, the method comprising:

• training the multimodal model, comprising an image model comprising a vision encoder component and a large language model (LLM) component, to generate a trained multimodal model;
• transforming a set of images generated during a session with a patient, into a set of image representations;
• returning a set of radiology outputs upon processing the set of image representations with the multimodal model, wherein the multimodal model is structured to process image-based inputs and language-based inputs;
• detecting an anomaly captured in the set of images, using the trained multimodal model;
• determining that the anomaly is associated with a clinical indication;
• retrieving a set of candidate actions to perform based upon the clinical indication;
• transforming the set of radiology outputs into a report comprising a style and level of completion above a threshold level of completion;
• transmitting the report to the radiologist;
• and
• executing an action of the set of candidate actions, wherein the action comprises administering care according to a critical results workflow corresponding to the clinical indication.