Systems and methods for computer-assisted shape measurements in video

A system for guiding a minimally invasive procedure, the system comprising one or more computer processors and one or more non-transitory computer-readable storage media storing instructions that are operable, when executed by said one or more computer processors, to cause said one or more computer processors to perform operations comprising:

• receiving a video stream captured by an imaging device;
• processing said video stream using processing modules including:
• a tool recognition module, a tooltip reference sizing module, an anatomy recognition module, and a tool tracking module, wherein said processing comprises:
• identifying a surgical tool and one or more elements in said video stream, wherein said one or more elements comprises one or more of an anatomical structure, an operational procedure or action, or a pathology;
• and
• labeling said identified one or more elements in said video stream;
• receiving an indication from an operator to select one or more of a plurality of points or an area in said video stream;
• calculating one or more measurements for said selected area in said video stream;
• wherein said one or more measurements comprise one or more of a length, a surface area, a circumference, or a volume, further wherein said tooltip reference sizing module estimates a size of tooltip of said identified surgical tool using a trained machine learning algorithm, and wherein a pathology sizing module estimates a size of said identified pathology based at least partially on said estimated size of tooltip;
• and
• displaying said measurements on a displaying device intraoperatively to be used by an operator during said arthroscopic procedure.