Methods and devices for quantifying text similarity

A computer-implemented method for quantifying text similarity, comprising:

• obtaining a plurality of shortest operation paths for correcting an optical correction recognition (OCR) text string with an edit text string, wherein each of the plurality of shortest operation paths includes one or more edit pairs, each of the one or more edit pairs denoting an operation performable to a character of the OCR text string during correction by the edit text string;
• determining a plurality of similarity scores, each of the plurality of similarity scores corresponding to one of the plurality of shortest operation paths, wherein each of the plurality of similarity scores is determined by summing historical similarity scores of the one or more edit pairs of each of the plurality of shortest operation paths, wherein summing the historical similarity scores of the one or more edit pairs comprises:
• retrieving the historical similarity scores of the one or more edit pairs from a history data library,
• adding the edit pairs in the shortest operation path having the minimum similarity score into the history data library,
• updating the historical similarity scores for the edit pairs in the history data library, wherein updating the historical similarity scores comprises:
• calculating frequencies of edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score,
• determining historical similarity scores for the edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score by:
• performing a log frequency calculation for each of the edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score and normalizing the log frequency calculations to a range of 0.0 to 1.0;
• and
• selecting a minimum one of the plurality of similarity scores to quantify text similarity between the OCR text string and the edit text string.

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations to index blockchain data for storage, comprising:

• obtaining a plurality of shortest operation paths for correcting an optical correction recognition (OCR) text string with an edit text string, wherein each of the plurality of shortest operation paths includes one or more edit pairs, each of the one or more edit pairs denoting an operation performable to a character of the OCR text string during correction by the edit text string;
• determining a plurality of similarity scores, each of the plurality of similarity scores corresponding to one of the plurality of shortest operation paths, wherein each of the plurality of similarity scores is determined by summing historical similarity scores of the one or more edit pairs of each of the plurality of shortest operation paths, wherein summing the historical similarity scores of the one or more edit pairs comprises:
• retrieving the historical similarity scores of the one or more edit pairs from a history data library,
• adding the edit pairs in the shortest operation path having the minimum similarity score into the history data library,
• updating the historical similarity scores for the edit pairs in the history data library, wherein updating the historical similarity scores comprises:
• calculating frequencies of edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score, and
• determining historical similarity scores for the edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score by:
• performing a log frequency calculation for each of the edit pairs in the history data library corresponding to the edit pairs in the shortest operation path having the minimum similarity score and normalizing the log frequency calculations to a range of 0.0 to 1.0;
• and
• select a minimum one of the plurality of similarity scores to quantify text similarity between the OCR text string and the edit text string.