System and method for providing visual guidance in a medical surgery

A system for providing visual guidance in a medical surgery, the system comprising:

• a virtual assistance device having a combination of a virtual medical implant, an Intra-Medullary (IM) nail model and a virtual insertion handle model, the virtual assistance device configured for:
• registering, within the virtual assistance device, a construct having at least one of a physical IM nail implant and a physical insertion handle, wherein the registering is performed by scanning a first QR code attached to the physical insertion handle, and wherein the first QR code is sensed by the virtual assistance device, and wherein the virtual IM nail model creates a virtual impression of the physical IM nail implant and the physical insertion handle within the virtual assistance device;
• registering, within the virtual assistance device having a drill gun model, a physical drill gun by scanning a second QR code attached to the physical drill gun, wherein the drill gun model creates a virtual impression of the physical drill gun within the virtual assistance device;
• registering within the virtual assistance device, through one or more third QR codes inserted on one or more holes, coordinates of one or more holes with respect to the coordinates of the virtual impression of the physical IM nail implant and the physical insertion handle, wherein the one or more hole(s) are provided over the physical IM nail implant for accepting screws during the medical surgery;
• displaying, over the virtual assistance device, each of the virtual impression of the physical IM nail implant inside a target, the virtual impression of the physical drill gun, and the coordinates of the one or more holes while inserting, each of the physical IM nail implant and the physical insertion handle into the target;
• positioning, the virtual impression of the physical drill gun over the virtual impression of the physical IM nail implant inside the target;
• aligning, the virtual impression of the physical drill gun over the one or more holes based on the coordinates of the one or more holes registered within the virtual assistance device, wherein the aligning guides movement of the physical drill gun over the target in real-time while performing one or more surgical steps over the target through the physical drill gun.

A virtual assistance device for providing visual guidance in a medical surgery, the virtual assistance device comprising:

• a memory storing each of an Intra-Medullary (IM) nail model, a virtual insertion handle model, and a drill gun model;
• a processor configured to execute a set of instructions stored in the memory, wherein the processor is configured for:
• registering, a construct having at least one of a physical IM nail implant and a physical insertion handle, wherein the registering comprising:
• scanning a first QR code attached to the physical insertion handle, and wherein the first QR code is sensed by in the virtual assistance device, and wherein the virtual IM nail model creates a virtual impression of the physical IM nail implant and the physical insertion handle within the virtual assistance device;
• registering, a physical drill gun, the registering comprising:
• scanning a second QR code attached to the physical drill gun,
• wherein the drill gun model creates a virtual impression of the physical drill gun within the virtual assistance device;
• registering, through one or more third QR codes inserted on one or more holes provided over the physical IM nail implant for accepting screws during the medical surgery, coordinates of the one or more holes with respect to the coordinates of the virtual impression of the physical IM nail implant and the physical insertion handle;
• a user interface configured for:
• displaying, each of the virtual impression of the physical IM nail implant inside a target, the virtual impression of the physical drill gun, and the coordinates of the one or more holes while inserting, each of the physical IM nail implant and the physical insertion handle into the target;
• and
• wherein the processor is configured for:
• positioning, the virtual impression of the physical drill gun over the virtual impression of the physical IM nail implant inside the target;
• and
• aligning, the virtual impression of the physical drill gun over the one or more holes based on the coordinates of the one or more holes registered within the virtual assistance device, wherein the aligning guides movement of the physical drill gun over the target in real-time while performing one or more surgical steps over the target through the physical drill gun.

A method for providing visual guidance in a medical surgery, the method comprising:

• registering, by a processor, a construct having at least one of a physical IM nail implant and a physical insertion handle within a virtual assistance device, wherein the registering comprising:
• scanning a first QR code attached to the physical insertion handle, and wherein the first QR code is sensed by the virtual assistance device, and wherein a virtual IM nail model creates a virtual impression of the physical IM nail implant and the physical insertion handle within the virtual assistance device;
• registering, by the processor, a physical drill gun, the registering comprising:
• scanning a second QR code attached to the physical drill gun, wherein a drill gun model creates a virtual impression of the physical drill gun within the virtual assistance device;
• registering, by the processor, through one or more third QR codes inserted on one or more holes provided over the physical IM nail implant for accepting screws during the medical surgery, coordinates of the one or more holes with respect to the coordinates of the virtual impression of the physical IM nail implant and the physical insertion handle;
• and
• wherein each of the virtual impression of the physical IM nail implant inside a target, the virtual impression of the physical drill gun, and the coordinates of the one or more holes are displayed on a user interface while inserting, each of the physical IM nail implant and the physical insertion handle into the target;
• positioning, by the processor, the virtual impression of the physical drill gun over the virtual impression of the physical IM nail implant inside a target;
• and
• aligning, by the processor, the virtual impression of the physical drill gun over the one or more holes based on the coordinates of the one or more holes registered within the virtual assistance device, wherein the aligning guides movement of the physical drill gun over the target in real-time while performing one or more surgical steps over the target through the physical drill gun.