Hybrid approach to perform dynamic projection mapping onto robotic figures in real-time

A method of activating a robot comprising:

• actuating a mechanical movement of a projection surface positioned over an robotic structure to change a topographical shape of a portion of the projection surface, wherein the projection surface defines a continuous projection surface over the robotic structure;
• projecting, by a projector, a content specific to the change of the topographical shape on the projection surface;
• detecting a position of the mechanical movement of the projection surface, a position of the projection surface, or a combination thereof;
• providing feedback to a controller regarding the position of the mechanical movement of the projection surface, the position of the projection surface, or the combination thereof, the change of the topographical shape, and the content;
• and
• modifying the content based on the feedback.

A non-transitory computer-readable media comprising instructions to cause a robot to:

• actuate a mechanical movement of a mouth feature of a projection surface positioned over a robotic structure to change a topographical shape of the mouth feature of the projection surface, wherein the projection surface defines a continuous projection surface over the robotic structure;
• project, by a projector, a content specific to the change of the topographical shape on the mouth feature of the projection surface;
• detect a position of the mouth feature of the projection surface;
• provide feedback to a controller regarding the position of the mouth feature of the projection surface, the change of the topographical shape and the content;
• and
• modify the content based on the feedback.