Adaptive visibility enhancement in transparent augmented reality displays

An augmented reality system comprising:

• a tracker;
• a transparent display arranged on an optical path of a real-world light field from a real-world environment;
• at least one real-world facing camera;
• and
• at least one processor configured to:
• determine a relative position of each eye of at least one user with respect to the transparent display, using the tracker;
• generate or retrieve an image to be displayed, based on the relative position of each eye of the at least one user with respect to the transparent display;
• for a given region of the image that represents a graphical element, determine a corresponding portion of the transparent display from which light rays of the given region of the image are to be directed toward a given eye of the at least one user during display of the image, based on a relative position of the given eye with respect to the transparent display, and a position of the given region in the image;
• capture at least one real-world image of the real-world environment using the at least one real-world facing camera;
• determine a colour and luminance of a portion of the real-world light field that passes through the corresponding portion of the transparent display toward the given eye, based on the at least one real-world image and the relative position of the given eye with respect to the transparent display;
• calculate a colour difference and a luminance difference for the given eye between the colour and luminance of said portion of the real-world light field and a colour and luminance of the graphical element;
• adjust at least one of:
• the colour, the luminance, a size, at least one iconographic parameter of the graphical element in the given region of the image, based on the colour difference and the luminance difference for the given eye;
• and
• display the image via the transparent display for producing a synthetic light field, wherein the transparent display is employed to optically combine a corresponding portion of the synthetic light field with said portion of the real-world light field.