Stable identification of entity mentions

A computer program product for stable identification of entities mentioned in dynamic documents, the computer program product comprising computer-readable program code to be executed by one or more processors when retrieved from a non-transitory computer-readable medium, the program code comprising instructions configurable to cause:

• processing a corpus of documents to identify a first plurality of mentions of a first plurality of entities;
• assigning a unique identifier to each of the first plurality of mentions identified in the corpus of documents;
• storing each unique identifier and each corresponding one of the first plurality of mentions in a database;
• detecting an updated document containing a change to text in a document from the corpus of documents;
• processing the updated document to identify a second plurality of mentions of a second plurality of entities;
• comparing the second plurality of mentions to the first plurality of mentions;
• for each aligned mention from the second plurality of mentions in the updated document corresponding to one of the first plurality of mentions in the document, storing the aligned mention in the database in association with one of the unique identifiers for the one of the first plurality of mentions;
• and
• for each new mention from the second plurality of mentions not corresponding to one of the first plurality of mentions, storing the new mention in the database as a new entry with a new unique identifier.

A database system comprising:

• at least one database storing entity mentions from a corpus of documents and corresponding identifiers;
• and
• at least one server having at least one processor capable of executing instructions configured to cause the server to perform the steps of:
• processing the corpus of documents to identify a first plurality of mentions of a first plurality of entities;
• assigning a unique identifier to each of the first plurality of mentions identified in the corpus of documents;
• storing each unique identifier and each corresponding one of the first plurality of mentions in the at least one database;
• detecting an updated document containing a change to text in a document from the corpus of documents;
• processing the updated document to identify a second plurality of mentions of a second plurality of entities;
• comparing the second plurality of mentions to the first plurality of mentions to identify one or more repeated ones of the first plurality of mentions in the second plurality of mentions;
• for each aligned mention from the second plurality of mentions in the updated document corresponding to one of the first plurality of mentions in the document, storing the aligned mention in the at least one database in association with one of the unique identifiers for the corresponding one of the first plurality of mentions;
• and
• for each new mention from the second plurality of mentions not corresponding to one of the first plurality of mentions, storing the new mention in the at least one database as a new entry with a new unique identifier.