Systems and methods for mixed reality medical training

A system for training a student in medical condition identification and intervention, the system comprising:

• a wearable mixed reality viewing device, the wearable mixed reality viewing device comprising a non-planar viewing surface, a first wireless transceiver, and a first processor, the first processor comprising a first memory and;
• a computing device, the computing device being in a wireless client-server based relationship with the wearable mixed reality viewing device, the computing device comprising a substantially flat display screen, a second wireless transceiver, and a second processor, the second processor comprising a second memory;
• a physical object, the physical object being in a first location and comprising a third processor and a third wireless transceiver, the physical object being in wireless communication with the computing device, and wherein the physical object comprises moveable internal components being responsive to wireless communications from the computing device to present visually perceptible movement of the physical object;
• one or more fiducial markers placed in a predetermined position on a surface of the physical object;
• wherein one of the wearable mixed reality viewing device and the computing device comprises non-transitory computer-readable medium having in memory executable instructions for:
• storing a fixed location in space, the fixed location being in known relationship to the one or more fiducial markers;
• translating one or more points from the one or more fiducial markers in a non-depth camera point-of-view from the wearable mixed reality viewing device to one or more anchor points related to a 3D spatial map generated by the wearable mixed reality viewing device;
• anchoring a virtual image of at least a portion of a virtual patient to the fixed location, the virtual image being viewable on both the wearable mixed reality viewing device and the computing device;
• storing a scenario in the memory of the first processor, the scenario comprising parameters for visualization of the medical condition in the virtual patient and comprising a plurality of stages, each stage representing a time-based state of the medical condition;
• storing the scenario in the memory of the second processor;
• selecting the scenario, the selected scenario being transmitted as parameters of the virtual image to the first processor of the wearable mixed reality viewing device and to the third processor of the physical object;
• commanding the second processor to initiate displaying the virtual image in a selected one of the plurality of stages, whereupon the virtual image is viewed in a three dimensional augmented reality view on the non-planar viewing surface of the mixed reality viewing device and in two dimensions on the substantially flat display screen of the computing device, the virtual image presenting one or more virtual critical cues corresponding to the time-based state of the medical condition;
• commanding the physical object to present movement corresponding to one or more physical critical cues of the time-based state of the medical condition;
• assessing a student's identification of the one or more virtual critical cues;
• and
• assessing the student's identification of the one or more physical critical cues.

A system for training a student in medical condition identification and intervention, the system comprising:

• a wearable mixed reality viewing device, the wearable mixed reality viewing device comprising a non-planar viewing surface and a first processor, the first processor comprising a first memory and a first wireless transceiver, the first memory storing a scenario, the scenario comprising parameters for visualization of a medical condition in a virtual patient, the medical condition comprising a plurality of stages, each stage representing a time-based state of the medical condition, and wherein the virtual patient presents one or more virtual critical cues corresponding to one or more of the plurality of stages;
• a computing device, the computing device being in a wireless client-server based relationship with the wearable mixed reality viewing device, the computing device comprising a substantially flat display screen and a second processor, the second processor comprising a second memory and a second wireless transceiver, the computing device recording an assessment of a student's identification of the one or more virtual critical cues;
• a physical object, the physical object comprising a third processor and a third wireless transceiver, the physical object being in wireless communication with the computing device, and wherein the physical object comprises moveable internal components being responsive to wireless communications from the computing device to present visually perceptible movement of the physical object;
• wherein one of the wearable mixed reality viewing device and the computing device comprises non-transitory computer-readable medium having in memory executable instructions for:
• anchoring a virtual image of at least a portion of the virtual patient on at least a portion of the physical object, the virtual image being viewable on both the wearable mixed reality viewing device and the computing device;
• selecting the scenario, the selected scenario being transmitted as parameters of the virtual image to the first processor of the wearable mixed reality viewing device and to the third processor of the physical object;
• initiating displaying the virtual image in a selected one of the plurality of stages, whereupon the virtual image is viewed in a three dimensional augmented reality view on the non-planar viewing surface of the wearable mixed reality viewing device and in two dimensions on the substantially flat display screen of the computing device;
• and
• initiating the physical object to present movement corresponding to one or more physical critical cues of the time-based state of the medical condition.