Systems and methods for optical performance captured animated figure with real-time reactive projected media

A reactive media system of an amusement attraction, the reactive media system comprising:

• one or more interactive data sources configured to generate interactive data that is variable over time;
• a motion control system comprising:
• an animated figure disposed within the amusement attraction, wherein the animated figure comprises a figure portion that comprises a moveable joint;
• a set of actuators disposed within the figure portion and configured to actuate the moveable joint;
• and
• a set of trackers coupled to the figure portion of the animated figure;
• and
• a media control system comprising:
• a tracking camera configured to:
• determine a respective position of each tracker of the set of trackers based on a visualization of the set of trackers;
• and
• generate a signal indicative of a current position and of a current orientation of the animated figure based on the respective position of each tracker of the set of trackers;
• and
• a media controller communicatively coupled to the tracking camera and configured to:
• receive the signal indicative of the current position and of the current orientation of the animated figure from the tracking camera;
• generate content to be projected onto a portion of the animated figure based on the current position and the current orientation of the animated figure;
• identify a non-operational portion of the animated figure based on the determined respective position of each tracker of the set of trackers;
• and
• adjust the generated content based on the identified non-operational portion.

A method of operating a reactive media system of an amusement attraction, the method comprising:

• receiving, via a figure controller of an animated figure, interactive data from one or more interactive data sources of the amusement attraction;
• generating, via the figure controller, an interactive response of the animated figure based on the interactive data;
• instructing, via the figure controller, one or more actuators disposed within the animated figure to perform the interactive response by actuating a movable joint of the animated figure via actuation of the one or more actuators;
• receiving, via a media controller, sensor feedback indicative of a current position and a current orientation of a figure portion of the animated figure from a tracking camera coupled to the media controller, wherein the tracking camera is configured to sense the current position and the current orientation based on at least one tracker coupled to a first surface of the animated figure;
• generating, via the media controller, data indicative of images to be projected onto at least a second surface of the figure portion having the current position and the current orientation, wherein the second surface comprises an external surface and wherein the second surface is different than the first surface;
• and
• instructing, via the media controller, a projector to project the images onto the second surface of the figure portion having the current position and the current orientation.