Augmented reality guidance for vascular procedures

A system for guiding a vascular procedure in a patient comprising:

• a stereoscopic optical head mounted display;
• one or more processors;
• and
• a vascular device,
• wherein the one or more processors are configured to receive two-dimensional (2D) intra-procedural angiographic image data from a first imaging study,
• wherein the 2D intra-procedural angiographic image data are registered in a coordinate system,
• wherein the one or more processors are configured to receive intra-procedural ECG data of a phase of systole and/or a phase of diastole of the cardiac cycle of the patient,
• wherein the one or more processors are configured to tag the 2D intra-procedural angiographic image data with the ECG data from the phase of systole and/or diastole obtained during acquisition of the 2D intra-procedural angiographic image data,
• wherein the one or more processors are configured to receive three-dimensional (3D) pre-procedural vascular image data from a second imaging study,
• wherein the 3D pre-procedural vascular image data comprises images obtained during a phase of systole and/or a phase of diastole of a cardiac cycle of the patient, wherein the phase of the cardiac cycle of the patient is determined using an electrocardiogram (ECG) obtained during acquisition of the 3D pre-procedural vascular image data, wherein the 3D pre-procedural vascular image data are tagged with the ECG data from the phase of systole and/or diastole obtained during the acquisition of the 3D pre-procedural vascular image data,
• wherein the one or more processors are configured to align an anatomic structure in the 3D pre-procedural vascular image data with a corresponding anatomic structure in the 2D intra-procedural angiographic image data in the coordinate system,
• wherein the anatomic structure comprises a vascular structure, vascular landmark, vascular wall, vascular edge, vascular perimeter, vascular outline, vascular surface, vascular shape, vascular volume, vascular branch, vascular tree, take off of a vascular branch, or a combination thereof,
• wherein the one or more processors are configured to track the vascular device in real time in the coordinate system,
• wherein the one or more processors are configured to generate a 3D surface representation of at least a portion of the tracked vascular device, and wherein the one or more processors are configured to generate a 3D surface representation of at least a portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data,
• wherein the one or more processors are configured to generate a 3D stereoscopic view comprising the 3D surface representation of the at least the portion of the tracked vascular device and the 3D surface representation of the at least the portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data,
• wherein the stereoscopic optical head mounted display is configured to display the 3D stereoscopic view,
• wherein the one or more processors are configured to update the 3D stereoscopic view in real time for movement of the tracked vascular device, and
• wherein the one or more processors are configured to update the 3D stereoscopic view for movement of the at least the portion of the anatomic structure during the cardiac cycle of the patient by matching the display of the 3D surface representation of the at least the portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data with the intra-procedural ECG data, the ECG tagged intra-procedural angiographic image data, or a combination thereof.

A method for guiding a vascular procedure in a patient comprising:

• receiving intra-procedural electrocardiogram (ECG) data of a phase of systole and/or a phase of diastole of the cardiac cycle of the patient;
• receiving two-dimensional (2D) intra-procedural angiographic image data from a first imaging study,
• registering the 2D intra-procedural angiographic image data in a coordinate system;
• receiving intra-procedural ECG data of a phase of systole and/or a phase of diastole of the cardiac cycle of the patient,
• tagging the 2D intra-procedural angiographic image data with the ECG data from the phase of systole and/or diastole obtained during acquisition of the 2D intra-procedural angiographic image data,
• receiving three-dimensional (3D) pre-procedural vascular image data from a second imaging study;
• determining, using an ECG, a phase of a cardiac cycle of the patient during acquisition of the 3D pre-procedural vascular image data,
• wherein the 3D pre-procedural vascular image data comprises images from a phase of systole and/or a phase of diastole of the cardiac cycle of the patient,
• tagging the 3D pre-procedural vascular image data with the ECG data from the phase of systole and/or diastole obtained during acquisition of the 3D pre-procedural vascular image data,
• aligning an anatomic structure in the 3D pre-procedural vascular image data with a corresponding anatomic structure in the 2D intra-procedural angiographic image data in the coordinate system, wherein the anatomic structure comprises a vascular structure, vascular landmark, vascular wall, vascular edge, vascular perimeter, vascular outline, vascular surface, vascular shape, vascular volume, vascular branch, vascular tree, take off of a vascular branch, or a combination thereof;
• tracking a vascular device in the coordinate system;
• generating a 3D surface representation of at least a portion of the tracked vascular device;
• generating a 3D surface representation of at least a portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data;
• generating a 3D stereoscopic view comprising the 3D surface representation of the at least the portion of the tracked vascular device and the 3D surface representation of the at least the portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data;
• displaying the 3D stereoscopic view using a stereoscopic optical head mounted display;
• and
• updating the 3D stereoscopic view in real time for movement of the tracked vascular device and updating the 3D stereoscopic view for movement of the at least the portion of the anatomic structure during the cardiac cycle of the patient by matching the display of the 3D surface representation of the at least the portion of the anatomic structure from the ECG tagged 3D pre-procedural vascular image data with the intra-procedural ECG data, the ECG tagged intra-procedural angiographic image data, or a combination thereof.