Method and apparatus for entering data using a virtual input device

A method for a user to interact with a virtual input device using a user-controlled object to input information to a companion system, said virtual input device having at least one location defined thereon with which a function is associated, the method comprising the following steps:

• (a) using a single sensor system to acquire data representing a single image at a given time from which three-dimensional coordinate information may be determined as to relevant position of at least a portion of said user-controlled object such that a location defined on said virtual input device contacted by said user-controlled object is identifiable;
• (b) processing data acquired at step (a) to determine whether a portion of said user-controlled object contacted a location defined on said virtual input device, and if contacted to determine what function of said virtual input device is associated with said location;
• and
• (c) coupling information processed at step (b) as input to said companion system.

A method of determining interaction between a user-controlled object and a virtual input device, the method comprising the following steps:

• (a) defining a plurality of identifiable locations on said virtual input device;
• (b) sensing with a single sensor system that acquires data representing a single image at a given time three-dimensional positional coordinate information to detect contact between at least a portion of said user-controlled object and at least one of said identifiable locations defined on said virtual input device;
• and
• (c) determining an input function, associated with said virtual input device, assigned to at least one location sensed at step (b) of detected contact by said user-controlled object.

A method of determining interaction between a user-controlled object and a virtual input device, the method comprising the following steps:

• (a) defining a plurality of identifiable locations on said virtual input device;
• (b) sensing with a single sensor system that acquires a single image at a given time three-dimensional coordinate information to detect contact between said user-controlled object and at least one of said plurality of identifiable positions;
• and
• (c) determining an input function assigned to at least one of said identifiable positions sensed at step (b).

A system enabling a user to interact with a virtual keyboard using a user-controlled object to input information to a companion system, said virtual keyboard defining at least two virtual key locations, each of said virtual key locations having an associated function, the system comprising:

• a diffractive projection sub-system to project a user-viewable image of said virtual keyboard, said sub-system including at least one diffractive optical element;
• a single sensor system to acquire data representing a single image at a given time from which three-dimensional coordinate information may be determined as to relevant position of at least a portion of said user-controlled object with respect to said virtual keyboard such that identification of a virtual key location contacted by said user-controlled object is identifiable;
• means for processing information acquired from said single sensor system to determine whether a portion of said user-controlled object contacted a virtual key location, and if contacted to determine what function of said virtual keyboard is associated with said location;
• and
• means for coupling information so processed to said companion system.

A system enabling a user to interact with a virtual mouse using a user-controlled object to input information to a companion system, the system comprising:

• a diffractive projection sub-system to project a user-viewable image of said virtual mouse, said sub-system including at least one diffractive optical element;
• a single sensor system to acquire data representing a single image at a given time from which three-dimensional coordinate information may be determined as to relevant position of at least a portion of said user-controlled object so as to map real-time locus points representing movement of said user-controlled object to movement events of an actual mouse;
• means for processing information acquired from said single sensor system to determine whether a portion of said user-controlled object contacted said virtual mouse, and if contacted to determine relative movement and associated function of an actual mouse;
• and
• means for coupling information so processed to said companion system.