Surgery assistance system

A surgery assistance system comprising:

• a physically suitable jig configured to be attached to a predetermined attached portion of a body on which surgery is performed, wherein the predetermined attached portion is a bone;
• and
• a surgery assistance apparatus which displays an augmented reality image to support the surgery,
• wherein
• the physically suitable jig includes:
• a site fitting unit which can be fitted in the predetermined attached portion which is the bone, and
• an image recognized unit which includes a feature which can be image-recognized to display an augmented reality image with the surgery assistance apparatus,
• the surgery assistance apparatus includes:
• a first obtainer which obtains a reference image regarding a three-dimensional shape of the predetermined attached portion of the body and a treated portion which is the bone and on which the surgery is performed, and first jig information including an attaching position of the physically suitable jig in a three-dimensional model based on the reference image,
• a second obtainer which obtains a captured image in which the physically suitable jig is attached to the predetermined attached portion and the treated portion which is the bone is imaged,
• a central processing unit (CPU) configured to recognize the image recognized unit of the physically suitable jig in the captured image obtained by the second obtainer, and to estimate a position and posture of the physically suitable jig in the captured image, and
• a display controller which, based on the reference image and the first jig information obtained by the first obtainer, overlaps on the captured image of the hone which is the treated portion a first augmented reality image virtually showing the treated portion which is the bone in a position and a posture corresponding to the position and the posture of the physically suitable jig in the captured image estimated by the CPU and displays the overlapped image on a display.