Back to results
US 2019/0197062 A1Published application
Corpus-scoped annotation and analysis
AssigneeInternational Business Machines Corporation
InventorsJOEL C. DUBBELS, MARK G. MEGERIAN, WILLIAM C. RAPP
Life of this patent
Estimating the term…
Abstract
Corpus-scoped annotation and analysis. Enrichment analysis data is generated including annotations and metadata for a plurality of documents that are part of a corpus. Whether to generate a second set of annotations is determined, based on a correlation of the annotations and metadata. A relational database is populated with the enrichment analysis data. A corpus-scoped query is resolved, initiated by an application, using the enrichment analysis data and content of the corpus.
Claims1
A computer program product comprising:
- a computer-readable storage medium having program instructions embodied therewith, wherein the computer-readable storage medium is not a transitory signal per se, the program instructions comprising:
- program instructions to produce a collection of prepared data, from structured and unstructured data, utilizing rule-based and/or machine learning techniques, wherein the structured and unstructured data is provided by a content provider;
- program instructions to produce a collection of vetted data, based on the collection of prepared data, utilizing a subject matter expert to create a dictionary of terms;
- program instructions to create a trained algorithm based on the collection of vetted data;
- program instructions to utilize the trained algorithm in combination with at least one feature from the group consisting of:
- language identification, semantic scoring, lemmatization, clustering and classification, key phrase extraction, synonym expansion, document and entity sentiment calculation, predictive analytics, and trending entity identification to generate, by one or more computer processors, enrichment analysis data, wherein the enrichment analysis data includes annotations and metadata for a plurality of documents that are part of a corpus;
- program instructions to determine, by the one or more computer processors, whether to generate a second set of annotations, based on a correlation of the annotations and metadata;
- program instructions to determine, by the one or more computer processors, whether to generate a second set of annotations, utilizing a re-trained algorithm, wherein the re-trained algorithm is created in response to updates to the collection of vetted data;
- program instructions to determine whether to update the enrichment analysis data with the second set of annotations;
- program instructions to populate, by the one or more computer processors, a relational database with the enrichment analysis data, wherein the relational database is configured to manage content of the documents and participate in incremental ingestion during population of the relational database with enrichment analysis data, and wherein the relational database is configured to provide versioning capabilities for the enrichment analysis data stored in the relational database;
- and
- program instructions to resolve, by the one or more computer processors, a corpus-scoped query initiated by an application using the enrichment analysis data and content of the corpus, wherein resolving the corpus-scoped query comprises optimizing, by the one or more computer processors, the corpus-scoped query through a query optimization feature of a relational database management system for the relational database.
9 more elements
Dependencies are inferred from the claim text.