Digitally overlaying an image with another image

A system for digitally overlaying an image with another image, comprising

• a storage for storing a model of a real world space, wherein the model includes an overlay surface to be overlaid with an overlay image, wherein the overlay surface in the model represents a display device in the real world, wherein the display device is configured to display a moving image on the display device in the real world by emitting radiation in one or more pre-determined frequency ranges;
• a camera parameter interface for receiving camera parameters, which calibrate at least one camera with respect to coordinates of the model;
• a camera image interface for receiving at least one image captured with respective said at least one camera substantially at the same time, said at least one captured image comprising a detection image, wherein the camera used to capture the detection image is configured to detect radiation having a frequency outside all of the one or more pre-determined frequency ranges and distinguish the detected radiation outside all of the one or more pre-determined frequency ranges from radiation inside the one or more pre-determined frequency ranges;
• a positioner for determining a position of the overlay surface within said at least one captured image based on the model and the camera parameters;
• a detector for detecting an occluding object at least partially occluding the overlay surface in a selected captured image of said at least one captured image based on an image property of the occluding object and the detection image;
• an overlayer for overlaying a non-occluded portion of the overlay surface in the selected captured image with the overlay image to obtain an output image, wherein the overlayer is configured to overlay the moving image displayed on the display device in the real world with the overlay image in the selected captured image;
• and
• an output interface for outputting the output image.

A method of digitally overlaying an image with another image, comprising

• creating a model of a real world space, wherein the model includes an overlay surface to be overlaid with an overlay image, wherein the overlay surface in the model represents a display device in the real world, wherein the display device is configured to display a moving image on the display device in the real world by emitting radiation in one or more pre-determined frequency ranges;
• identifying camera parameters, which calibrate at least one camera with respect to coordinates of the model;
• capturing at least one image with respective said at least one camera substantially at the same time, said at least one captured image comprising a detection image, wherein the camera used to capture the detection image is configured to detect radiation having a frequency outside all of the one or more pre-determined frequency ranges and distinguish the detected radiation outside all of the one or more pre-determined frequency ranges from radiation inside the one or more pre-determined frequency ranges;
• positioning the overlay surface within said at least one captured image based on the model and the camera parameters;
• detecting an occluding object at least partially occluding the overlay surface in a selected captured image of said at least one captured image based on an image property of the occluding object and the detection image;
• overlaying a non-occluded portion of the overlay surface in the selected captured image with the overlay image, by overlaying the moving image displayed on the display device in the real world with the overlay image in the selected captured image.

A non-transitory computer-readable medium on which is stored a computer program product comprising instructions that, when executed by a computer, cause the computer to perform the steps of

• storing a model of a real world space, wherein the model includes an overlay surface to be overlaid with an overlay image, wherein the overlay surface in the model represents a display device in the real world, wherein the display device is configured to display a moving image on the display device in the real world by emitting radiation in one or more pre-determined frequency ranges;
• receiving camera parameters, which calibrate at least one camera with respect to coordinates of the model;
• receiving at least one image captured with respective said at least one camera substantially at the same time, said at least one captured image comprising a detection image, wherein the camera used to capture the detection image is configured to detect radiation having a frequency outside all of the one or more pre-determined frequency ranges and distinguish the detected radiation outside all of the one or more pre-determined frequency ranges from radiation inside the one or more pre-determined frequency ranges;
• determining a position of the overlay surface within said at least one captured image based on the model and the camera parameters;
• detecting an occluding object at least partially occluding the overlay surface in a selected captured image of said at least one captured image based on an image property of the occluding object and the detection image;
• overlaying a non-occluded portion of the overlay surface in the selected captured image with the overlay image to obtain an output image by overlaying the moving image displayed on the display device in the real world with the overlay image in the selected captured image;
• and
• outputting the output image.