Augmenting reality with multiscopic see-through display

A system comprising:

• tracking means;
• a transparent display;
• a controllable parallax barrier arranged on an optical path of the transparent display;
• and
• at least one processor configured to:
• utilise the tracking means to determine a relative location of a first eye and of a second eye of at least one user with respect to the transparent display;
• retrieve or generate a first virtual image and a second virtual image representing at least one virtual object from a perspective of the first eye and the second eye of the at least one user, based on the relative location of the first eye and of the second eye of the at least one user with respect to the transparent display, respectively;
• determine a union of at least one first image segment in the first virtual image and at least one second image segment in the second virtual image that represent the at least one virtual object;
• determine a given portion of the transparent display whereat said union of the at least one first image segment and the at least one second image segment is to be presented;
• and
• display a light field image via the transparent display, whilst controlling the controllable parallax barrier, based on the relative location of the first eye and of the second eye of the at least one user with respect to the transparent display, to direct light produced by a first set of pixels and a second set of pixels of the light field image towards the first eye and the second eye, respectively, the first set of pixels being generated from the at least one first image segment in the first virtual image, the second set of pixels being generated from the at least one second image segment in the second virtual image,
• wherein, when controlling the controllable parallax barrier, the at least one processor is configured to activate a given portion of the controllable parallax barrier that corresponds to the given portion of the transparent display.