System including head wearable display device and imperceptible reference fiducials and method therefor

A method for a vehicle, comprising:

• providing cockpit reference fiducials in a vehicle cockpit, each of the cockpit reference fiducials located at a different location within the vehicle cockpit, wherein at least two of the cockpit reference fiducials are imperceptible cockpit reference fiducials, the imperceptible cockpit reference fiducials being imperceptible to a naked eye of a user in the vehicle cockpit, wherein the imperceptible cockpit reference fiducials are transparent quick response (QR) codes;
• providing a head wearable display device in the vehicle cockpit, the head wearable display device configured to be worn by the user, the head wearable display device comprising:
• at least one optical sensor and a display;
• displaying, by the display, images aligned with a field of view of the user;
• capturing, by the at least one optical sensor, images of the imperceptible cockpit reference fiducials;
• outputting, by the at least one optical sensor, optical sensor image data;
• providing at least one processor, one or more of the at least one processor communicatively coupled to the at least one optical sensor, one or more of the at least one processor implemented in the head wearable display device;
• receiving, by the at least one processor, the optical sensor image data;
• and
• based at least on the optical sensor image data, determining, by the at least one processor, a position and orientation of the head wearable display device, wherein the display is configured to display the images aligned with the field of view of the user based at least on the determined position and the determined orientation of the head wearable display device.

A system, comprising:

• reference fiducials, each of the reference fiducials located at a different location within an environment, wherein at least two of the reference fiducials are imperceptible reference fiducials, the imperceptible reference fiducials being imperceptible to a naked eye of a user in the environment, wherein the imperceptible reference fiducials are transparent quick response (QR) codes;
• a head wearable display device configured to be worn by the user, the head wearable display device comprising:
• a display configured to display images aligned with a field of view of the user;
• and
• at least one optical sensor configured to:
• capture images of the imperceptible reference fiducials;
• and
• output optical sensor image data;
• at least one processor, one or more of the at least one processor communicatively coupled to the at least one optical sensor, one or more of the at least one processor implemented in the head wearable display device, the at least one processor configured to:
• receive the optical sensor image data;
• and
• based at least on the optical sensor image data, determine a position and orientation of the head wearable display device,
• wherein the display is configured to display the images aligned with the field of view of the user based at least on the determined position and the determined orientation of the head wearable display device.