System for monitoring object inserted into patient's body via image processing

A system for image-based monitoring of an object inserted into a patient, the system comprising:

• a database configured to store a trained model for an object configured to be inserted into a patient as part of a medical procedure, the trained model being generated from one or more machine learning algorithms that are trained on annotated images of the object with spatial information of the object, wherein the trained model is configured to be used to determine spatial information from unannotated images of the object;
• an imaging computer system that is configured to:
• receive, from an imaging device, one or more images of the object inserted within the patient, wherein the imaging device is configured to capture the one or more images of the object from a position external to the patient,
• access the trained model for the object from the database,
• determine, based on applying the trained model to the one or more images of the object, current spatial information of the object within the patient, and
• provide the current spatial information of the object within the patient;
• and
• a display to monitor the object within the patient, the display being configured to output (i) the one or more images of the object as captured by the imaging device from the position external to the patient, and (ii) the current spatial information of the object within the patient as determined based on application of the trained model to the one or more images.