System and method for augmented reality guidance for use of medical equipment systems with transmission of data to remote location

A method, comprising:

• providing, by at least one tool condition sensor, tool condition data relating to one or more of a movement, a position, an orientation, and a status of at least one tool manipulable by a user of a medical equipment system during at least a portion of a medical procedure performed on a patient by said user of said medical equipment system;
• providing, by said medical equipment system, medical equipment system data relating to an operation of said medical equipment system,
• generating, by a controller, procedure instruction data based at least in part on said tool condition data and/or said medical equipment system data;
• presenting, by an augmented reality user interface (ARUI), said procedure instruction data to said user during at least a portion of said procedure,
• providing, by at least one patient sensor, patient data relating to said patient at one or more times during said medical procedure;
• and
• transmitting, to a remote location, one or more of said tool condition data, said medical equipment system data, said patient data, or said procedure instruction data.

A guidance system for providing real-time augmented reality (AR) feedback guidance in a use of a medical equipment system, said guidance system comprising:

• a medical equipment interface to said equipment system, wherein said equipment interface is capable of receiving data from said equipment system during a medical procedure performed by a user on a patient, wherein said data comprises patient data relating to said patient at one or more times during said medical procedure;
• an augmented reality user interface (ARUI) for presenting data pertaining to both real and virtual objects to said user during at least a portion of said performance of said procedure;
• a guidance system (GS) that is capable of sensing real-time user positioning data relating to one or more of a movement, position, and orientation of at least a portion of said equipment system during said procedure performed by said user;
• a library containing 1) stored reference positioning data relating to one or more of said movement, position, and orientation of at least a portion of said equipment system during a reference procedure and 2) stored reference outcome data relating to an outcome of said reference procedure;
• a machine learning module (MLM) for providing at least one of 1) position-based AR feedback to said user based on said sensed user positioning data and said reference positioning data, and 2) outcome-based AR feedback to said user based on data received from said equipment system during said procedure performed by said user and reference outcome data;
• and
• a communication module configured to transmit one or more of said patient data, said real-time user positioning data, said position-based AR feedback, or said outcome-based AR feedback to a remote location.