Real time perception of and response to the actions of an unencumbered participant/user

A process for controlling a device adapted to perform a plurality of operations to perceive, process and respond in real time to a plurality of demonstrative behaviors of at least one unmarked participant, said process comprising:

• associating each of a plurality of demonstrative behaviors of at least one unmarked participant with a respective operation of said device;
• generating low level code associated with said operations, said low level code including at least one independent primitive module;
• controlling a plurality of special purpose processors of said device in accordance with said low level code;
• and
• sequencing the control of said special purpose processors in accordance with a performed sequence of said demonstrative behaviors so as to realize real time performance of a corresponding sequence of said operations.

A device for representing graphically, in real time, at least one unmarked participant in a demonstrative activity associated with said participant, said device comprising:

• means for obtaining a contrasting image of said unmarked participant;
• means for digitizing said contrasting image to provide a digitized image;
• means for timing control of said means for obtaining said contrasting image;
• means for ascertaining features of said digitized image;
• means connected to said means for timing control for storing ascertained features of said digitized image and for processing said stored ascertained features of said digitized image;
• means for identifying at least one characteristic of at least one of said ascertained features, each of the identified characteristics being a selected one of a location and a movement of a respective ascertained feature of said digitized image;
• means responsive to said means for identifying for controlling said means for storing and for processing so as to provide information indicative of a demonstrative activity of said participant;
• and
• means responsive to said information for updating a selected one of a graphic and a manipulatable image representation, in real time, of a demonstrative behavior of said participant.

A method for perceiving, processing and responding, in real time, to a demonstrative behavior of at least one unmarked participant, the method comprising the steps of:

• imaging said unmarked participant to obtain an analog image of the same;
• converting said image from analog to digital form to obtain a digitized form of said image;
• first processing said digitized form of said image to obtain desired features from said digitized form of said image;
• storing said obtained desired features;
• synchronizing said first processing and storing by establishing at least one characteristic of said desired features for identification and comparison with said stored desired features, each of the characteristics being a selected one of a location and a movement of a respective feature;
• further processing, in real time, said stored desired features and said at least one characteristic to provide processed features;
• and
• projecting, in an imaged environment, a processed image of said processed features, in real time.