Predicting and Enhancing Document Ingestion Time
AssigneeInternational Business Machines Corporation
InventorsCorville O. Allen, Andrew R. Freed
Life of this patent
Estimating the term…
Abstract
A mechanism is provided in a data processing system for predicting and enhancing ingestion time for a set of input documents. The mechanism receives a set of documents to be added to a corpus of the data processing system. The mechanism records document features of each document within the set of documents using an annotation engine within the data processing system. The mechanism predicts an ingestion time for each document within the set of documents based on the document characteristics and a machine learning model. The mechanism assigns the set of documents to data processing system resources to be processed based on the predicted ingestion time for each document.
Claims20
A method, in a data processing system, for predicting and enhancing ingestion time for a set of input documents, the method comprising:
- receiving a set of documents to be added to a corpus of documents;
- recording document features of each document within the set of documents using an annotation engine within the data processing system;
- predicting an ingestion time for each document within the set of documents based on the document characteristics and a machine learning model;
- and
- assigning the set of documents to data processing system resources to be processed based on the predicted ingestion time for each document.
A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:
- receive a set of documents to be added to a corpus of documents;
- record document features of each document within the set of documents using an annotation engine within the computing device;
- predict an ingestion time for each document within the set of documents based on the document characteristics and a machine learning model;
- and
- assign the set of documents to question answering system resources to be processed based on the predicted ingestion time for each document.
An apparatus comprising:
- a processor;
- and
- a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:
- receive a set of documents to be added to a corpus of documents;
- record document features of each document within the set of documents using an annotation engine within a data processing system;
- predict an ingestion time for each document within the set of documents based on the document characteristics and a machine learning model;
- and
- assign the set of documents to question answering system resources to be processed based on the predicted ingestion time for each document.
Dependencies are inferred from the claim text.