Augmented reality-based firefighter training system and method

A method of accomplishing an augmented reality firefighter training system for a user, comprising:

• providing a head-worn display unit;
• providing a real device that the user can operate to simulate applying extinguishing agent, to be carried by the user during firefighter training;
• providing motion tracking hardware, and attaching it both to the head-worn display unit and the extinguishing agent device;
• using the motion tracking hardware that is attached to the head worn unit to determine the location and direction of the viewpoint of the head-worn display unit;
• using the motion tracking hardware that is attached to the extinguishing agent device to determine the location and direction of the extinguishing agent device;
• determining the operating state of the extinguishing agent device;
• using a computer to generate graphical elements comprising simulated fire graphical elements, simulated multiple layer smoke obscuration graphical elements, and simulated application of an extinguishing agent, showing the extinguishing agent itself emanating directly from the extinguishing agent device, and showing the interaction and extinguishing of the agent with the fire;
• rendering the generated graphical elements to correspond to the user's viewpoint;
• and
• creating for the user a mixed view comprised of an actual view of the real world as it appears in front of the user, where graphical elements can be placed any place in the real world and remain anchored to that place in the real world regardless of the direction in which the user is looking, wherein the rendered graphical elements are superimposed on the actual view, to accomplish an augmented reality view of fire and smoke in the real world, and the application of extinguishing agent to the fire, and the effect of extinguishing agent on the fire.