Systems and methods for surgical data classification

A system for determining a surgical task classification, comprising:

• at least one processor, coupled to memory and configured to:
• receive a plurality of sets of surgical data for a surgical procedure, each set of surgical data corresponding to a respective modality type;
• identify, for each modality type, a type of machine learning model to use based at least on the respective modality type;
• execute, for each modality type, the identified type of machine learning model on features derived from the corresponding set of surgical data to generate a classification result for each modality type;
• and
• determine a surgical task classification for the surgical procedure based at least on the classification result for each modality type.

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method for determining a surgical task classification, the method comprising:

• receiving a plurality of sets of surgical data for a surgical procedure, each set of surgical data corresponding to a respective modality type;
• identifying, for each modality type, a type of machine learning model to use based at least on the respective modality type;
• executing, for each modality type, the identified type of machine learning model on features derived from the corresponding set of surgical data to generate a classification result for each modality type;
• and
• determining a surgical task classification for the surgical procedure based at least on the classification result for each modality type.