Augmented reality display for cardiac and vascular procedures with compensation for cardiac motion

A system comprising:

• a stereoscopic optical head mounted display;
• and
• one or more processors,
• wherein the one or more processors are configured to receive images tagged with electrocardiogram (ECG) data and respiratory cycle data obtained during a phase of systole and/or a phase of diastole of a cardiac cycle of a patient and obtained during at least a portion of a respiratory cycle of the patient,
• wherein the ECG data of the cardiac cycle of the patient are determined using an electrocardiogram (ECG) obtained during image acquisition,
• wherein the respiratory cycle data of the patient are determined by measuring at least one respiratory parameter during the image acquisition,
• wherein the one or more processors are configured to generate ECG and respiratory cycle data tagged three-dimensional (3D) stereoscopic views comprising ECG data tags and respiratory cycle data tags based on information from the tagged images,
• wherein the ECG and respiratory cycle data tagged images comprise information about (a) a direction of cardiac or vascular movement or pulsation, speed of cardiac or vascular movement or pulsation, an amount of cardiac or vascular movement or pulsation, or a combination thereof, and (b) diaphragmatic movement, direction of respiratory movement, speed of respiratory movement, an amount of respiratory movement or a combination thereof,
• wherein the one or more processors are configured to receive real time intra-operative ECG data of a phase of systole and/or a phase of diastole of a cardiac cycle of the patient and intra-operative respiratory cycle data of the patient during a medical, radiologic, or surgical procedure,
• wherein the one or more processors are configured to match the ECG data tags and the respiratory cycle data tags of the 3D stereoscopic views with the corresponding intra-operative ECG data and the corresponding intra-operative respiratory cycle data
• wherein the one or more processors are configured to display, by the stereoscopic optical head mounted display, the ECG data and the respiratory cycle data tagged 3D stereoscopic views superimposed or aligned with a beating heart or a pulsating physical vascular structure of the patient during the phase of systole and/or the phase of diastole and during the respiratory cycle, and
• wherein the one or more processors are configured to adjust the ECG and respiratory data tagged 3D stereoscopic views displayed by the stereoscopic optical head mounted display synchronized with both cardiac and respiratory movement of the beating heart or the pulsating physical vascular structure.