Machine learning for object tracking

Abstract

The present disclosure provides systems and methods capable of determining a roll angle of a medical instrument in real time based on one or more medical images that include the medical instrument. In different versions, the images may be, for example, fluoroscopic, ultrasound, and/or video. The roll angle may be determined using one or more machine learning models. Other degrees of freedom may also be determined. The roll angle (and potentially other degrees of freedom) may be used in visualizations that guide a user of the medical instrument. The visualization may employ various displays and/or headsets, and may be used with an augmented reality (AR) system, a mixed reality (MR) system, a virtual reality (VR) system, an extended reality (XR) system, and/or a spatial computing system.

Dependencies are inferred from the claim text.