Method and apparatus for gesture interaction with a photo-active painted surface

A system, comprising:

• an audio-visual sensor coupled to monitor a surface and an area in front of the surface, and provide sensor data in response;
• an electromagnetic (EM) modulator coupled to stimulate generation of an image on the surface, wherein photoactive compounds disposed on the surface generate the image in response to the stimulation, and wherein the EM modulator stimulates image generation in response to one or more control signals;
• and
• a non-transitory computer readable storage medium including instructions that, when executed by a processor, cause the system to:
• receive first sensor data from the audio-visual sensor;
• determine, based on the first sensor data, a context for a user with respect to the surface;
• provide the one or more control signals to the EM modulator in response to the determination of the context for the user, wherein the one or more control signals cause the EM modulator to stimulate generation of an image of a control interface, the control interface associated with a connected system different than the system;
• receive second sensor data from the audio-visual sensor, the second sensor data including user motion;
• and
• determine, based on the second sensor data, that the user motion is indicative of a gesture associated with the image of the control interface displayed on the surface;
• and
• control the connected system in response to the gesture.