Image Data Set Alignment for an AR Headset Using Anatomic Structures and Data Fitting

A method, comprising:

• aligning an image data set representing an anatomical structure of a patient to an X-ray generated image of at least a portion of the anatomical structure and a radiopaque marker with an optical code, by using data fitting to align the anatomical structure shared between the image data set and the X-ray generated image;
• defining a location of the radiopaque marker with the optical code in the image data set using alignment with the X-ray generated image;
• and
• aligning the image data set with a body of the patient, based in part on an optical code of a radiopaque marker defined in the image data set as referenced to the optical code of the radiopaque marker visible on the patient, using an AR headset.

A method, comprising:

• aligning an image data set representing an anatomical structure in a patient to an X-ray generated image of at least a portion of the anatomical structure by using data fitting to align the anatomical structure that is shared in the image data set and the X-ray generated image;
• defining a location of a radiopaque marker with an optical code in the image data set using alignment with the X-ray generated image;
• aligning the image data set with a body of the patient, using an optical code of a radiopaque marker visible on the patient and the optical code of the radiopaque marker defined in the image data set;
• determining an orientation and position of an X-ray imaging C-arm which captured the X-ray generated image, using a plurality of optical codes on the X-ray imaging C-arm;
• constructing a slice of the image data set in a plane based in part on an orientation and position of a plane of the X-ray generated image;
• and
• displaying the slice and X-ray generated image to form a graphical view as an overlay to the patient using an AR headset.

A system, comprising:

• at least one processor of an AR headset;
• a memory device of the AR headset including instructions that, when executed by the at least one processor, cause the system to:
• obtain an image data set and a two dimensional (2D) X ray generated image of an anatomical structure containing at least one image visible marker
• align an image data set to a two-dimensional (2D) X-ray generated image by using data fitting to align an anatomical structure that is shared between the image data set and the 2D X-ray generated image;
• define a location of an image visible marker with an optical code in the image data set using alignment with the 2D X-ray generated image;
• and
• align the image data set with a body of a patient viewable through the AR headset, based in part on the image visible marker with the optical code visible on the patient as referenced to an optical code of the image visible marker represented in the image data set.