Systems, methods, apparatuses, and computer-readable media for image guided surgery

A system for image guided surgery, comprising:

• a computer system, wherein the computer system is configured to:
• determine device type information for a first medical device;
• determine real-time emplacement information for the first medical device;
• determine real-time emplacement information for a second medical device;
• determine the real-time relative emplacements of the first and second medical devices;
• determine a 2D image plane based at least on the real-time emplacement information for the second medical device;
• determine at least based on the device type of the first medical device, real-time prediction information for the first medical device, wherein the prediction information comprises a plurality of graphical indicators of the real-time relative emplacement of a plurality of portions of the first medical device and the image plane, wherein each graphical indicator indicates whether a corresponding portion of the first medical device is in front of or behind the image plane;
• receive, in real-time, a 2D image corresponding to at least a portion of the determined 2D image plane from the second medical device;
• determine a perspective view of the 2D image within a virtual 3D space in response to real-time relative emplacement information for the second medical device with respect to a position of a user;
• generate image guidance information based at least on the real-time relative emplacements of the first and second medical devices and the real-time prediction information for the first medical device;
• cause one or more displays to display a graphical rendering of the image guidance information;
• and
• cause the one or more displays to display in real time the perspective view of the 2D image within the virtual 3D space.

A non-transitory computer-readable medium comprising computer-executable instructions, said instructions, when executed cause one or more processors to:

• determine device type information for a first medical device;
• determine real-time emplacement information for the first medical device;
• determine real-time emplacement information for a second medical device;
• determine the real-time relative emplacements of the first and second medical devices;
• determine a 2D image plane based at least on the real-time emplacement information for the second medical device;
• determine at least based on the device type of the first medical device, real-time prediction information for the first medical device, wherein the prediction information comprises a plurality of graphical indicators of the real-time relative emplacement of a plurality of portions of the first medical device and the image plane, wherein each graphical indicator indicates whether a corresponding portion of the first medical device is in front of or behind the image plane;
• receive, in real-time a 2D image corresponding to at least a portion of the determined 2D image plane from the second medical device;
• determine a perspective view of the 2D image within a virtual 3D space in response to real-time relative emplacement information for the second medical device with respect to a position of a user;
• generate image guidance information based at least on the real-time relative emplacements of the first and second medical devices and the real-time prediction information for the first medical device;
• cause one or more displays to display a graphical rendering of the image guidance information;
• and
• cause the one or more displays to display in real time the perspective view of the 2D image within the virtual 3D space.