Automatic segmentation and registration system and method

A method for holographic augmented reality visualization and guidance in performing a medical procedure on a patient by a user, the method comprising the steps of:

• providing a system having an augmented reality system configured to display a plurality of operating information of the patient in an augmented reality environment, a first holographic image acquisition system, a second holographic image acquisition system, and a computer system having a deformation engine;
• acquiring, by the first holographic image acquisition system, preoperative data from the patient;
• acquiring, by the second holographic image acquisition system, intraoperative data from the patient;
• selectively registering the preoperative data to the plurality of operating information;
• selectively registering the intraoperative data to the plurality of operating information;
• selectively generating, by the computer system, fused data;
• selectively adjusting the preoperative data according to the deformation engine where the preoperative data does not align with the intraoperative data;
• transmitting, by the computer system, the plurality of operating information to the augmented reality system;
• selectively displaying, by the augmented reality system, the intraoperative data where the intraoperative data permits the user to navigate a body of a patient;
• selectively displaying, by the augmented reality system, the preoperative data where the intraoperative data does not substantially permit the user to navigate the body of the patient;
• selectively displaying, by the augmented reality system, the fused data where both the preoperative data and the intraoperative data permit the user to navigate the body of the patient;
• and
• selectively adjusting, by the user, the plurality of operating information in real-time.