Augmented reality display for fitting, sizing, trialing and balancing of virtual implants on the physical joint of a patient for manual and robot assisted joint replacement

A system for preparing a physical joint in a patient, the system comprising:

• at least one processor,
• a see through optical head mounted display, and
• a user interface,
• wherein the user interface is configured to select a virtual implant component from a library of virtual implant components,
• wherein the system is configured to generate a stereoscopic view of at least a portion of the virtual implant component,
• wherein the virtual implant component is a three-dimensional digital representation corresponding to at least one portion of a physical implant component, a placement indicator of the physical implant component, or a combination thereof,
• wherein the see through optical head mounted display is configured to display the stereoscopic view of the at least portion of the virtual implant component onto a surface of the physical joint visible directly through the see through optical head mounted display, so as to superimpose the at least portion of the virtual implant component onto the surface of the physical joint,
• wherein the system is configured to allow superimposition and alignment of the at least portion of the virtual implant component with at least one anatomic structure of the physical joint, and wherein the at least one anatomic structure is registered in a coordinate system.