US 6,677,932 B1 · System and method for recognizing touch typing under limited tactile feedback conditions

Abstract

A system is disclosed for recognizing typing from typing transducers that provide the typist with only limited tactile feedback of key position. The system includes a typing decoder sensitive to the geometric pattern of a keystroke sequence as well as the distance between individual finger touches and nearby keys. The typing decoder hypothesizes plausible key sequences and compares their geometric pattern to the geometric pattern of corresponding finger touches. It may also hypothesize home row key locations for touches caused by hands resting on or near home row. The resulting pattern match metrics may be combined with character sequence transition probabilities from a spelling model. The typing decoder then chooses the hypothesis sequence with the best cumulative match metric and sends it as key codes or commands to a host computing device.

Claims18

Dependent claims

A typing recognition apparatus for touch typing on surfaces with limited tactile feedback that compensates for finger and hand drift during typing and discourages any integrated spelling model from choosing dictionary words over unusual but carefully typed strings, the apparatus comprising:

a typing surface means that displays symbols indicating the locations of touchable keys;
touch sensor means that provides the surface coordinates of each touch by a typist attempting to strike said key symbols on said surface;
hypothesis tree generator means that extends existing key hypothesis sequences with hypotheses for keys in the neighborhood of each new touch;
pattern geometry evaluation means that computes geometry match metrics for the hypothesized key sequences by comparing separation vectors between the successive touch locations with separation vectors between the successively hypothesized key locations as well as by measuring the zero-order key/touch alignment error;
decoding means that finds the hypothesized key sequence with the best cumulative match metric;
and,
transmission means for communicating the symbols and commands represented by the best hypothesized key sequence to host computer applications.

4 more elements

A method for recognizing typing from typing devices that sense lateral finger position but provide limited tactile feedback of key location, the method advantageously compensating for finger and hand drift during typing and discouraging any integrated spelling model from choosing dictionary words over unusual but carefully typed strings, wherein the method comprises the following steps:

forming a touch location and time sequence from the fingertip position at the end of each keystroke as measured by typing sensors;
computing a set of touch separation vectors of increasing orders from the location difference between the newest touch and previous touch in said touch location sequence;
generating a set of key hypothesis sequences for the given touch sequence, each hypothesis in a sequence being for a key near the location of the touch causing the hypothesis;
for each key hypothesis, computing a set of key separation vectors of increasing orders from differences between the position of the newest key and previous keys in the hypothesized sequence;
for each key hypothesis, computing a geometry match metric as a function of the magnitude of the zero-order touch/key alignment error as well as of the magnitudes of each order's touch and key separation vector difference;
combining the geometry match metrics from each hypothesis in a key hypothesis sequence into a cumulative match metric for the hypothesis sequence;
choosing the hypothesized key sequence with the best cumulative metric as the best hypothesized key sequence;
and,
transmitting the symbols and commands represented by the best hypothesized key sequence to a host computer for further action.

6 more elements

forming a touch location and time sequence from the fingertip position at the end of each keystroke as measured by typing sensors;
generating a set of key hypothesis sequences for the given touch sequence, each hypothesis in a sequence being for a key near the location of the touch causing the hypothesis;
for each key hypothesis, computing a key/touch alignment error vector as the difference between the location of the hypothesized key and the location of its causing touch;
for each key hypothesis, computing a geometry match metric as a function of the magnitude of the hypothesis' key/touch alignment error as well as of the magnitude of differences between the hypothesis' key/touch alignment error vector and that of preceding hypotheses in its sequence;
combining the geometry match metrics from each hypothesis in a key hypothesis sequence into a cumulative match metric for the hypothesis sequence;
choosing the hypothesized key sequence with the best cumulative metric as the best hypothesized key sequence;
and,
transmitting the symbols and commands represented by the best hypothesized key sequence to a host computer for further action.

5 more elements

Dependencies are inferred from the claim text.

System and method for recognizing touch typing under limited tactile feedback conditions

Life of this patent

System and method for recognizing touch typing under limited tactile feedback conditions

Life of this patent

Abstract

Claims18