Method and system for training a handwriting recognizer at the time of misrecognition

A method in a computer system for collecting data for use in training a handwriting recognizer, the handwriting recognizer having a recognition process by which it recognizes handwritten data as symbols, the handwriting recognizer having a training process by which it receives handwritten data and symbols and adjusts its recognition process based on the received handwritten data and the received symbols, the method comprising the computer-implemented steps of:

• collecting handwritten data on a computer handwriting input device;
• displaying the collected handwritten data on a computer output device;
• displaying recognized symbols that correspond to the collected handwritten data on the computer output device;
• selecting a portion of the displayed handwritten data that corresponds to recognized symbols that are misrecognized;
• and
• inputting at least one correct symbol that the selected portion of the displayed handwritten data should be recognized as by the handwriting recognizer for use in adjusting the recognition process of the handwriting recognizer based on the selected portion of the displayed handwritten data and the input correct symbol.

A computer system for training a handwriting recognizer to correctly recognize handwritten data that was previously misrecognized, the computer system comprising:

• a handwriting recognizer for receiving handwritten data and recognizing the handwritten data as symbols;
• a recognizer hook for storing the handwritten data and the recognized symbols;
• and
• a trainer comprising:
• means for displaying the stored handwritten data and the recognized equivalent symbols;
• means for selecting a portion of the displayed handwritten data that corresponds to recognized symbols that are misrecognized;
• means for inputting a correct symbol that the selected portion of the displayed handwritten data should be recognized as;
• and
• means for training the handwriting recognizer to recognize the selected portion of the handwritten data as the input correct symbol.

A method in a computer system of inputting data for the training of a handwriting recognizer, the method comprising the computer-implemented steps of:

• receiving handwritten data;
• receiving recognized symbols that correspond to the handwritten data;
• receiving a mapping from the recognized symbols to the handwritten data;
• selecting a recognized symbol that is misrecognized;
• displaying a portion of the handwritten data that corresponds to the selected symbol;
• and
• inputting a correct symbol that the displayed portion of the handwritten data is to be recognized as by the handwriting recognizer for use in training the handwriting recognizer to recognize the displayed portion of the handwritten data as the input correct symbol.

A method in a computer system for correcting misrecognition by a handwriting recognizer, the computer system including a memory and a display device, the memory having a database of prototypes with handwritten data and corresponding symbols, the method comprising the computer-implemented steps of:

• inputting raw handwritten data;
• recognizing the raw handwritten data as a plurality of symbols;
• sending the raw handwritten data and the recognized symbols to a trainer;
• and
• under control of the trainer,
• displaying the raw handwritten data and the recognized symbols on the display device;
• selecting recognized symbols that are misrecognized;
• re-displaying the raw handwritten data corresponding to the selected symbols on the display device;
• inputting correct symbols corresponding to the re-displayed handwritten data;
• training the handwriting recognizer to recognize the raw handwritten data corresponding to the selected symbols as the correct symbols;
• and
• updating the prototypes in the memory using the raw handwritten data and the corresponding correct symbols.