See-through operator awareness tool using synthesized viewpoints

A non-transitory computer-readable medium having executable instructions stored thereon that, when executed by one or more processors, cause a system to:

• use one or more imaging devices coupled to an exterior of an object to capture image data of a real-world environment surrounding the object;
• calculate an orientation of a head mounted display (HMD) positioned in an interior of the object;
• use at least the calculated orientation of the HMD to synthesize a field of view (FOV) of the image data with a FOV of the HMD;
• and
• render the synthesized FOV of the image data to the HMD.

A system, comprising:

• a plurality of omnidirectional video cameras adapted to be mounted on an exterior of an object;
• and
• a head mounted display (HMD) system comprising a HMD, the HMD system configured to:
• receive video captured by the plurality of omnidirectional video cameras of a real-world environment surrounding the object;
• calculate an orientation of the HMD while it is positioned in an interior of the object;
• using at least the calculated orientation of the HMD, synthesize a field of view (FOV) of the captured video with a FOV of the HMD;
• and
• render the synthesized FOV of the video to the HMD.