Back to results
US 7,734,554 B2Granted
Deploying a document classification system
AssigneeHewlett-Packard Development Company, L.P.
InventorsSteven J. Simske, Margaret M. Sturgill, Daniel J. Dyer
Life of this patent
Estimating the term…
Abstract
A system and method for deploying a document classification system include deploying a document classification system with a first classification engine configuration, and thereafter, automatically redeploying the document classification system with a second classification engine configuration in response to a cost function.
Claims18
A method for deploying a document classification system comprising:
- deploying a document classification system with a first classification engine configuration, including generating a plurality of classifications with which a document is associated and ranking the classifications based on a probability of correctness for each of the classifications;
- automatically redeploying the document classification system with a second classification engine configuration in response to a cost function based on a user preference regarding one or more cost factors selected from a throughput-performance cost factor indicating a number of documents processed by the document classification system in a given amount of time, a minimum distance cost factor indicating a minimum distance that a document classification is from the classified document's assigned class, a severity of errors cost factor indicating a severity of an error made in classifying and indexing a document, a licensing cost factor indicating a licensing cost for using a classification engine, a differential training cost factor indicating a particular type of ground truth document being analyzed, a retraining cost factor indicating retraining of the document classification system based on additional documents added to a set of ground truth documents, and a system resource cost factor indicating a relative amount of resources available for document classification on a front end of the document classification system and document indexing on a back end of the system.
One or more computer-readable media having computer-executable instructions configured for:
- determining a default classification engine configuration based on a document training set;
- deploying the default classification engine configuration in a document classification system;
- classifying one or more documents with the document classification system, including generating a plurality of classifications for each of the one or more documents and ranking the classifications based on a probability of correctness for each of the classifications;
- updating the document training set based on the one or more documents;
- and
- deploying a different classification engine configuration in the document classification system based on the updated document training set, the updated document training set including one or more cost factors selected from a throughput-performance cost factor indicating a number of documents that are processed by the document classification system in a given amount of time;
- a minimum distance cost factor indicating a minimum distance that a document classification is from the classified document's assigned class;
- a severity of errors cost factor indicating a severity of an error made in classifying and indexing a document;
- a licensing cost factor indicating a licensing cost for using a classification engine;
- a differential training cost factor indicating a particular type of ground truth document being analyzed;
- a retraining cost factor indicating retraining of the document classification system based on additional documents added to a set of ground truth documents;
- and a system resource cost factor indicating a relative amount of resources available for document classification on a front end of the document classification system and document indexing on a back end of the system.
9 more elements
A document classification and indexing system comprising:
- a document classifier having a first classification engine configuration to generate a ranked classification list and classify documents based on an initial document ground truth set;
- a document indexer configured to index documents classified by the document classifier based on the ranked classification list and to update the initial document ground truth set;
- and
- a cost function configured to incorporate the updated document ground truth set and test a plurality of classification engine configurations against the updated document ground truth set to determine whether the first classification engine configuration should be replaced,
- wherein the cost function is based on one or more cost factors selected from a throughput-performance cost factor indicating a number of documents that are processed by the document classification system in a given amount of time;
- a minimum distance cost factor indicating a minimum distance that a document classification is from the classified document's assigned class;
- a severity of errors cost factor indicating a severity of an error made in classifying and indexing a document;
- a licensing cost factor indicating a licensing cost for using a classification engine;
- a differential training cost factor indicating a particular type of ground truth document being analyzed;
- a retraining cost factor indicating retraining of the document classification system based on additional documents added to a set of ground truth documents;
- and a system resource cost factor indicating a relative amount of resources available for document classification on a front end of the document classification system and document indexing on a back end of the system.
8 more elements
A document classification and indexing system comprising:
- means for deploying a classification system with a first classification configuration based on a plurality of classifications with which a document is associated and a ranking of the classifications determined from a probability of correctness for each of the classifications;
- and
- means for automatically redeploying the classification system with a second classification configuration based on a cost function incorporating one or more cost factors selected from a throughput-performance cost factor indicating a number of documents that are processed by the document classification system in a given amount of time;
- a minimum distance cost factor indicating a minimum distance that a document classification is from the classified document's assigned class;
- a severity of errors cost factor indicating a severity of an error made in classifying and indexing a document;
- a licensing cost factor indicating a licensing cost for using a classification engine;
- a differential training cost factor indicating a particular type of ground truth document being analyzed;
- a retraining cost factor indicating retraining of the document classification system based on additional documents added to a set of ground truth documents;
- and a system resource cost factor indicating a relative amount of resources available for document classification on a front end of the document classification system and document indexing on a back end of the system.
6 more elements
Dependencies are inferred from the claim text.