Augmented displays for multi-surface and three-dimensional live performances

A system of augmenting a physical scene of a live performance via projection overlays for driving augmentation of the live performance, wherein the physical scene is part of a multiple scene set comprising at least a second physical scene adjacent to the physical scene in the multiple scene set, and wherein the live performance includes a storyline that spans the multiple scene set, the system comprising:

• a processor programmed to:
• access sensor information from a sensor device;
• identify a location on the physical scene at which a user device is directed based on the sensor information;
• generate one or more projection images to be newly projected onto the physical scene to augment the physical scene at the location;
• cause a projection device to project the one or more projection images onto the physical scene at the location;
• identify a first projection image associated with a first portion of the storyline;
• cause a first projection device to project the first projection image onto the physical scene;
• identify a second projection image associated with a second portion of the storyline;
• and
• cause a second projection device to project the second projection image onto the second physical scene after the first projection image is projected onto the physical scene.

A computer implemented method of augmenting a physical scene of a live performance via projection overlays with real-time signal detection for driving augmentation of the live performance, wherein the physical scene is part of a multiple scene set comprising at least a second physical scene adjacent to the physical scene in the multiple scene set, and wherein the live performance includes a storyline that spans the multiple scene set, the method comprising:

• emitting, by a beacon device, a beacon signal for positioning a user device in the physical scene;
• accessing, by a processor, location information relating to a location of the user device, the location information based on the beacon signal;
• identifying, by the processor, a location on the physical scene at which the user device is directed based on the location information;
• generating, by the processor, one or more projection images to be newly projected onto the physical scene to augment the physical scene at the location;
• causing, by the processor, a projection device to project the one or more projection images at the location;
• identifying, by the processor, a first projection image associated with a first portion of the storyline, the first projection image assigned to be projected by the projection device;
• causing, by the processor, the projection device to project the first projection image onto the physical scene;
• identifying, by the processor, a second projection image associated with a second portion of the storyline, the second projection image assigned to be projected by a second projection device;
• and
• causing, by the processor, the second projection device to project the second projection image onto the second physical scene after the first projection image is projected onto the physical scene.