Detection and mitigation of defects in multiscopic displays

A system comprising:

• a tracker;
• a multiscopic display;
• at least one camera that is positioned such that a display area of the multiscopic display lies within a field of view of the at least one camera at least partially;
• and
• at least one processor configured to:
• perform calibration to determine at least one parameter of a multiscopic optical element of the multiscopic display;
• determine respective optical locations of eyes of at least one user relative to the display area, using the tracker;
• determine or retrieve an optical location of the at least one camera relative to the display area;
• generate or retrieve respective images to be directed toward the eyes of the at least one user, based on the respective optical locations of the eyes relative to the display area;
• generate a first multiscopic image to be displayed via the multiscopic display, based on the respective images for the eyes of the at least one user, and the at least one parameter of the multiscopic optical element;
• display the first multiscopic image via the multiscopic display, whilst capturing at least one image of the display area using the at least one camera;
• calculate at least one expected image of the display area that is expected to be captured by the at least one camera during display of the first multiscopic image, based on the first multiscopic image, the at least one parameter of the multiscopic optical element, the respective optical locations of the eyes relative to the display area, and the optical location of the at least one camera relative to the display area;
• identify at least one defective sub-region of the display area, based on a comparison between the at least one expected image and the at least one captured image of the display area;
• determine whether the at least one defective sub-region overlaps at least partially with a sub-region of the display area to be used to present at least one virtual object, based on a location of the at least one virtual object in a second multiscopic image;
• and
• when it is determined that the at least one defective sub-region overlaps at least partially with the sub-region to be used to present the at least one virtual object,
• identify another sub-region of the display area that does not overlap with the at least one defective sub-region;
• relocate the at least one virtual object within the second multiscopic image to use the another sub-region for presenting the at least one virtual object;
• and
• display the second multiscopic image after relocating the at least one virtual object.