Control system using aesthetically guided gesture recognition

A system for authoring gestures for use by a gesture-based controller, comprising:

• a computer with a processor managing a display and a memory device;
• a gesture monitoring assembly including a set of sensors sampling data during performance of a gesture by a performer;
• and
• a gesture authoring tool run by the processor to:
• during the performance of the gesture by the performer, collect sets of sensor data from each of the sensors;
• display a graphical user interface (GUI) on a display device, wherein the GUI includes a graphical plot of each of the sets of sensor data;
• receiving and storing in the memory device user input identifying a subset of the sensors to include in a gesture definition;
• and
• for each of the graphical plots for the subset of the sensors included in the gesture definition, receiving and storing, in the memory device as part of the gesture definition, user input defining at least one of a starting position, an ending position, a maximum value, and a minimum value.

A gesture authoring method, comprising:

• collecting a set of data from a sensor during a data collection window;
• receiving first user input defining a gesture performance time period with a start time and an end time for performance of gesture by a performer during the collecting;
• creating a first gesture definition including the set of data from the sensor during the gesture performance time period;
• receiving second user input marking in the first gesture definition at least one of a start position, an end position, a maximum value, and a minimum value;
• and
• creating a second gesture definition comprising a modified version of the first gesture definition including the marking from the second user input.