Immersive video environment using near-infrared video compositing

A method, comprising:

• capturing, at an infrared detection camera of a matte camera system, a first portion of infrared light originating from an infrared light source through a display screen arranged between the matte camera system and the infrared light source;
• capturing, at a visible light detection camera of the matte camera system, visible light originating from a visible light source and traveling through the display screen;
• and
• projecting, from a display source, light onto the display screen, wherein the projection of the light onto the display screen is visible to a human subject in a performance area;
• wherein a second portion of infrared light originating from the infrared light source is blocked from reaching the infrared detection camera by the human subject in the performance area.

A method, comprising:

• capturing, at an infrared detection camera of a matte camera system, an infrared video stream of a first portion of infrared light originating from an infrared light source, wherein the infrared light source transmits the first portion of infrared light to the infrared detection camera through a display screen arranged between the matte camera system and the infrared light source, and wherein the infrared light source emits the infrared light within an enclosed structure;
• capturing, at a visible light detection camera of the matte camera system, a visible video stream of visible light originating from a visible light source, wherein the visible light source emits the visible light within the enclosed structure, and wherein the visible light is received through the display screen;
• determining a background portion of the visible video stream corresponding to an area surrounding the first portion of infrared light in the infrared video stream, wherein the area surrounding the first portion of infrared light corresponds to a second portion of the infrared light that is blocked by an object within the enclosed structure;
• removing the background portion of the visible video stream;
• generating a real-time video including a real-time video capture of the object from the visible video stream and a virtual background replacing the removed background portion;
• and
• projecting, from a display source, the real-time video reflected off the display screen, wherein the real-time video is visible within the enclosed structure from a perspective of the object.