Automatic extraction of domain specific terminology from a large corpus

A system for extracting jargon from a document corpus, the system comprising:

• a database storing the document corpus;
• an interface electrically connected to said database, said interface configured to receive a request to initiate a review of the document corpus based on a sub-domain input and provide a list of jargon terms;
• and
• a processor in communication with said database and said interface, said processor having
• a review module configured to review the document corpus in response to an initiation by said interface;
• a separation module configured to separate the document corpus into at least one sub-corpus defined by the sub-domain input and a remainder corpus defined by the document corpus less the at least one sub-corpus;
• a topic model module configured to build a first topic model to evaluate at least one term extracted from the at least one sub-corpus and a second topic model to evaluate the at least one term extracted from the remainder corpus;
• a similarity score module configured to generate and compare a first topic similarity score for a select one of the at least one term by the first topic model based on a first meaning of the select term as used in the at least one sub-corpus and a second topic similarity score by the second topic model based on a second meaning of the select term as used in the remainder corpus, wherein, for the select term, as a result of a corresponding difference between the first and second topic similarity scores for the select term in the sub-corpus measured against the select term in the remainder corpus being greater than a predetermined threshold, the select term is identified as a jargon term;
• and
• a term extraction module configured to extract the jargon term to provide a list of jargon terms including the jargon term through the user interface.

A computer program product for extracting jargon from a document corpus, the computer program product comprising:

• a computer readable storage medium having stored thereon:
• first program instructions executable by a processor to cause the processor to receive a sub-domain input to initiate a review of the document corpus stored in the database;
• second program instructions executable by the processor to cause the processor to separate the document corpus into at least one sub-corpus and a remainder corpus, wherein the at least one sub-corpus defined by the sub-domain input and the remainder corpus defined by the document corpus less the at least one sub-corpus;
• third program instructions executable by the processor to cause the processor to build a first topic model to evaluate at least one term extracted from the at least one sub-corpus and a second topic model to evaluate the at least one term extracted from the remainder corpus;
• fourth program instructions executable by the processor to cause the processor to generate a first topic similarity score with the similarity score module for a select one of the at least one term by the first topic model based on a first meaning of the select term as used in the at least one sub-corpus and a second topic similarity score with the similarity score module for the select term by the second topic model based on a second meaning of the select term as used in the remainder corpus;
• fifth program instructions executable by the processor to cause the processor to compare the first and second topic similarity scores, wherein, for the select term, as a result of a corresponding difference between the first and second topic similarity scores for the select term in the sub-corpus measured against the select term in the remainder corpus being greater than a predetermined threshold, the select term is identified as a jargon term;
• and
• sixth program instructions executable by the processor to cause the processor to provide a list of jargon terms including the jargon term through a user interface.