Intraoperative Systems and Methods for Determining and Providing for Display a Virtual Image Overlaid onto a Visual Image of a Bone

A method comprising:

• receiving information, collected by a measurement device, of a surface of a bone of a limb of a patient;
• determining a visual model of the bone based on the collected information of the surface of the bone;
• recognizing a position and a movement of the bone in physical space based on tracked reference points positioned on one or more of the bone or an anatomy of the patient and causing the visual model of the bone to reflect the position and the movement of the bone in physical space;
• recognizing a position and a movement of a surgical device in physical space based on tracked reference points positioned on the surgical device;
• and
• determining an axis of the limb based on reference points positioned on a medial malleoli of the patient, a lateral malleoli of the patient, and a base of an anterior cruciate ligament of the patient;
• and
• providing for display a virtual image overlaid onto the visual model of the bone, wherein the virtual image includes information for assisting in placement of the surgical device at a position on the bone based on the position and the movement of the surgical device in physical space and includes a display of the axis of the limb.

A non-transitory computer-readable medium having stored thereon instructions that when executed by a computing device that includes one or more processors causes the computing device to perform functions comprising:

• receiving information, collected by a measurement device, of a surface of a bone of a limb of a patient;
• determining a visual model of the bone based on the collected information of the surface of the bone;
• recognizing a position and a movement of the bone in physical space based on tracked reference points positioned on one or more of the bone or an anatomy of the patient and causing the visual model of the bone to reflect the position and the movement of the bone in physical space;
• recognizing a position and a movement of a surgical device in physical space based on tracked reference points positioned on the surgical device;
• and
• determining an axis of the limb based on reference points positioned on a medial malleoli of the patient, a lateral malleoli of the patient, and a base of an anterior cruciate ligament of the patient;
• and
• providing for display a virtual image overlaid onto the visual model of the bone, wherein the virtual image includes information for assisting in placement of the surgical device at a position on the bone based on the position and the movement of the surgical device in physical space and includes a display of the axis of the limb.