Using augmented reality in surgical navigation

A system comprising:

• a processor;
• a display;
• and
• a computer readable non-transitory medium containing programming instructions that, when executed, will cause the processor to:
• receive a first patient image showing at least a portion of a body of a patient and sensor data captured by one or more augmented reality (AR) sensors;
• receive a medical image showing at least one anatomical structure that is not detectable by the one or more AR sensors;
• generate a representation of the medical image;
• perform coregistration between the first patient image and the representation of the medical image to generate a transformation matrix;
• superimpose the representation of the medical image onto the first patient image based on the transformation matrix to form a superimposed image;
• display the superimposed image on the display;
• receive a second patient image showing the at least a portion of the body of the patient and sensor data captured by the one or more AR sensors;
• determine a change in the at least one anatomical structure based on a change between the first patient image and the second patient image, wherein the change is caused by cutting or drilling within the body of the patient during a surgical intervention;
• and
• update the superimposed image on the display based on detecting the change in the at least one anatomical structure.