System, method, and apparatus for pairing a short document to another short document from a plurality of short documents

A computer program product comprising a computer useable storage medium to store a computer readable program, wherein the computer readable program, when executed on a computer, causes the computer to perform operations for merging a new document with a document from a plurality of documents, the operations comprising:

• receiving a new document;
• for each of the new document and each document of a plurality of documents, generating a vector uniquely associated with each of the documents of the plurality of documents and the new document, wherein:
• the vector comprises a number of elements equal to a number of terms of interest;
• and
• for each term of interest, an associated element value of the vector is assigned as zero if the term of interest does not occur in the document and one if the term does occur in the document;
• for each document from the plurality of documents, determining a similarity between the vector for the new document and the vector for the document from the plurality of documents;
• selecting a document from the plurality of documents as related to the new document in response to:
• determining that the similarity between the vector for the new document and the vector for the document from the plurality of documents is greater than or equal to a threshold value;
• and
• determining that the similarity between the vector for the new document and the vector for the document from the plurality of documents is greater than or equal to the similarity between the vector for the new document and the vector for any other document from the plurality of documents;
• and
• merging the new document with the selected document if a document from the plurality of documents is selected.

A system comprising:

• a document repository to store a plurality of documents;
• a comparison engine comprising:
• a vector generator to generate a vector for each of a new document and a document from the document repository, wherein:
• the vector comprises a number of elements equal to a number of terms of interest;
• and
• for each term of interest, an associated element value of the vector is assigned as zero if the term of interest does not occur in the document, and one if the term does occur in the document;
• and
• a similarity generator to determine a similarity between the document and the document from the document repository, the similarity based on the vector for the new document and the vector for the document from the document repository;
• and
• a pairing engine comprising:
• a document receiver to receive the new document to be paired with the documents in the document repository;
• a document submitter to submit the new document to the comparison engine and direct the comparison engine to determine a similarity between the new document and each document of the plurality of documents in the document repository;
• and
• a pair indicator to indicate a pairing between the new document and a document in the document repository having the highest similarity with the new document if the similarity between the new document and the document in the document repository having the highest similarity with the new document is greater than or equal to a threshold value.