Method and device for optical input of commands or data

In a data processing system, a method of data input using video sensors for monitoring positions of an operator's hand with respect to keys on a virtual keyboard optically produced on a surface and for subsequent and correlated data recognition by corresponding key locations on the keyboard to the monitored positions of the fingers of the operator's hand, comprising the steps of:

• touching the keys with fingers of the operator's hand to input data;
• scanning by the video sensors adjacent to the keyboard to detect presence of the hand;
• following by the video sensors the contour of the detected present hand to detect positions of the fingers of the operator's hand;
• scanning by the video sensors along each of the fingers for determining locations of the tips of the fingers with respect to the keyboard to determine identification information of the keys touched with the fingers;
• optically detecting with one of the video sensors each touch of the keys on the keyboard by the fingers of the operator's hand, wherein the step of optically detecting each touch of each key includes the step of determining speed of each finger in motion for touching each respective key of the keyboard and detecting each touch providing the speed before each respective touch impact of each respective key exceeds a predetermined minimum value, the speed during the touch impact of each respective key exceeds the speed after the touch impact, and the speed after the touch impact of each respective key is less than the speed before a next key touch impact on the keys of the keyboard with the operator's finger;
• entering the identification information of the keys touched with the fingers into the data processing system to represent the input data;
• and
• monitoring subsequent positions of the fingers of the operator's hand and comparing the input data corresponding to each subsequent monitored finger position to the identification information of the keys touched, and corresponding each monitored position of the fingers of the operator's hand with individual key locations on the keyboard.

A data processing system for keyboard data input and positional data correlation corresponding to keys on the keyboard, comprising:

• a virtual keyboard generated optically on a surface for providing a presentation of a keyboard having a plurality of keys for touching with fingers from a hand of an operator;
• video sensors for monitoring the keyboard and the fingers of the operator's hand to generate image data representing positions in three dimensions of the fingers of the operator's hand with respect to the keyboard and the keys;
• means for processing responsive to the image data for generating input data representing identification information of the keys touched with the fingers of the operator's hand;
• and
• positional data correlation means for detecting an occurrence when the video sensors monitor that one of the fingers of the operator's hand generates three dimensional image data corresponding to identification information of one of the respective touched keys of the keyboard.

A method of keyboard data input into a data processing system using a video sensor for determining vertical positions of an operator's fingers with respect to keys on a keyboard surface, comprising the steps of:

• hitting the keys with the operator's fingers,
• monitoring the keyboard and the operator's fingers by the video sensor to detect a sequence of successive motions of each of the operator's fingers in the vertical direction from the keyboard surface with respect to each of the operator's fingers;
• detecting the keys hit with each of the operator's fingers based on the sequence of successive motions and the vertical positions of each respective operator finger;
• and
• entering identification information of the detected keys of the keyboard into the data processing system to represent input data for correlation to subsequent hitting of the keys by the operator's fingers.

In a data processing system, a method of data input using video sensors for monitoring positions of an operator's hand with respect to keys on a virtual keyboard optically produced on a surface and for subsequent and correlated data recognition by corresponding key locations on the keyboard to the monitored positions of the fingers of the operator's hand, comprising the steps of:

• touching the keys with fingers of the operator's hand to input data;
• scanning by the video sensors adjacent to the keyboard to detect presence of the hand;
• following by the video sensors the contour of the detected present hand to detect positions of the fingers of the operator's hand;
• scanning by the video sensors along each of the fingers for determining locations of the tips of the fingers with respect to the keyboard to determine identification information of the keys touched with the fingers;
• optically detecting with one of the video sensors each touch of the keys on the keyboard by the fingers of the operators hand, wherein the step of optically detecting each touch comprises the step of determining speed of the finger in motion to touch the key of the keyboard during a touch impact on the key which includes the step of measuring the dynamic impact of the finger at the time of the touch of the finger of the operator's hand to the keyboard surface;
• entering the identification information of the keys touched with the fingers into the data processing system to represent the input data;
• and
• monitoring subsequent positions of the fingers of the operator's hand and comparing the input data corresponding to each subsequent monitored finger position to the identification information of the keys touched, and corresponding each monitored position of the fingers of the operator's hand with individual key locations on the keyboard.