System and method for low-latency streaming of volumetrically captured live events across multiple venues as holograms

A system for streaming a real-time volumetrically captured, holographically projected experience with a low-latency, the system comprising:

• a volumetric capture rig configured to capture volumetric data of a subject at a primary venue in three dimensions in real time;
• a low-latency streaming module configured to encode, compress, and transmit the volumetric data to a plurality of remote venues remote from the primary venue;
• one or more holographic display devices located at each of the plurality of remote venues and configured to render the volumetric data as one or more holograms visible from multiple angles;
• an audio system synchronized with the one or more holographic display devices and configured to provide audio according to locations and movement of the subject;
• a real-time audience feedback module comprising sensors and software, the real-time audience feedback module being configured to capture crowd data at one of the plurality of remote venues and to transmit the crowd data to (i) the primary venue and (ii) another of the plurality of remote venues;
• and
• one or more processors comprising an orchestration layer that is configured to synchronize visual, audio, and interactive elements across the plurality of remote venues,
• wherein the orchestration layer is further configured to dynamically re-light the one or more holograms to match lighting conditions at each of the plurality of venues based on the crowd data transmitted from at least one of the plurality of remote venues,
• wherein the orchestration layer is further configured to, in response to audience feedback received from a first remote venue among the plurality of remote venues, trigger remote lighting, audio, and visual effects at a second remote venue among the plurality of remote venues to thereby synchronize the interactive elements across the primary venue, the first remote venue, and the second remote venue.