Dynamic three-dimensional object mapping for user-defined control device

A computer implemented method to interactively capture and utilize a three-dimensional object to be a controlling device for a computer system, comprising:

• (a) identifying the three-dimensional object, the identifying including,
• (i) capturing depth data of the three-dimensional object;
• (ii) processing captured depth data of the three-dimensional object to create geometric defining parameters for the three-dimensional object;
• (iii) defining correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system;
• and
• (iv) saving to a recognized object database the geometric defining parameters of the three-dimensional object and correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system;
• and
• (b) presenting the three-dimensional object to a camera;
• and
• (c) moving the presented three-dimensional object in front of the camera so as to trigger one or more of the particular actions to be performed by the computer system.

A system for using a three-dimensional object as a controlling device when interfacing with a computer system, comprising:

• a camera that is configured to capture data from a three-dimensional space;
• the computer system being interfaced with the camera;
• storage being linked to the computer system;
• and
• a display coupled to the computer system, the display being configured to display a plurality of graphical display screens to enable set-up of a capture session to obtain geometric parameters of an object and assign actions to be performed with the object when moved in front of the camera during an interactive session, the geometric parameters and the assigned actions being saved to a database on the storage for access during the interactive session;
• wherein the assigned actions being custom defined by a user for particular movements made by the user on the object when holding the object in front of the camera.