Operating environment comprising multiple client devices, multiple displays, multiple users, and gestural control

A system comprising:

• a processor coupled to a plurality of display devices and a plurality of sensors;
• a plurality of remote client devices coupled to the processor;
• and
• a plurality of applications coupled to the processor, wherein the plurality of applications orchestrate content of the plurality of remote client devices simultaneously across at least one of the plurality of display devices and the plurality of remote client devices, and allow simultaneous control of the plurality of display devices, wherein the simultaneous control comprises automatically detecting a gesture of at least one object from gesture data received via the plurality of sensors, wherein the gesture data is absolute three-space location data of an instantaneous state of the at least one object at a point in time and space, the detecting comprising aggregating the gesture data, and identifying the gesture using only the gesture data, the plurality of applications translating the gesture to a gesture signal, and controlling at least one of the plurality of display devices and the plurality of remote client devices in response to the gesture signal.