Systems and methods for augmented reality assisted trauma fixation

An augmented reality assisted trauma fixation system comprising:

• a processor;
• a mixed reality display;
• an image capture device;
• a tracking system;
• and
• a non-transitory, processor-readable storage medium that stores instructions executable by the processor to:
• obtain a three-dimensional model of a bone;
• obtain a location of a fixation plate relative to the bone;
• obtain a location of a previously placed anchor device relative to the bone;
• determine, based on the location of the fixation plate, the location of the previously placed anchor device, the three-dimensional model of the bone, and a property of one or more anchor devices, a preferred pose of the one or more anchor devices that prevents the one or more anchor devices from intersecting with the previously placed anchor device
• determine, in conjunction with the preferred pose, a preferred location of the one or more anchor devices based on a potential bending load applied by the bone on the one or more anchor devices;
• display, on the mixed reality display, one or more visual indicators associated with the preferred pose and the preferred location of the one or more anchor devices, wherein the preferred pose and the preferred location of the one or more anchor devices promote healing of the bone;
• generate a time-sequenced preview of future surgical states and implant-anatomy interactions by executing a machine learning model trained to translate a current surgical state at a first time period to a future surgical state at a second time period, wherein the machine learning model is trained on a dataset comprising sampled surgical states over a plurality of time periods, and wherein the time-sequenced preview comprises a series of images that incrementally display surgical states based on an insertion of the one or more anchor devices over a period of time;
• display, on the mixed reality display, the time-sequenced preview;
• track, using the tracking system, a pose of a guide device utilized for placing the one or more anchor devices;
• and
• generate a notification corresponding to whether the pose of the guide device aligns with the preferred pose of the one or more anchor devices at the preferred location.

A mixed reality display device configured to be communicably coupled to a tracking system, the mixed reality display device comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, cause the processor to:
• obtain a three-dimensional model of a bone;
• obtain a location of a fixation plate relative to the bone;
• obtain a location of a previously placed anchor device relative to the bone;
• determine, based on the location of the fixation plate, the location of the previously placed anchor device, the three-dimensional model of the bone, and a property of one or more anchor devices, a preferred pose of the one or more anchor devices that prevents the one or more anchor devices from intersecting with the previously placed anchor device;
• determine, in conjunction with the preferred pose, a preferred location of the one or more anchor devices based on a potential bending load applied by the bone on the one or more anchor devices;
• display one or more visual indicators associated with the preferred location and the preferred pose of the one or more anchor devices, wherein the preferred pose and the preferred location of the one or more anchor devices promote healing of the bone;
• generate and display a time-sequenced preview of future surgical states and implant-anatomy interactions by executing a machine learning model trained to translate a current surgical state at a first time period to a future surgical state at a second time period, wherein the machine learning model is trained on a dataset comprising sampled surgical states over a plurality of time periods, and wherein the time-sequenced preview comprises a series of images that incrementally display surgical states based on an insertion of the one or more anchor devices over a period of time;
• track a pose of a guide device utilized for placing the one or more anchor devices;
• and
• generate a notification corresponding to whether the pose of the guide device aligns with the preferred pose of the one or more anchor devices at the preferred location.