System and method for determining confidence levels for the results of a categorization system
AssigneeInternational Business Machines Corporation
InventorJohn Martin Prager
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorJohn Martin Prager
Estimating the term…
After a categorization process has been run, the scores of the top-two ranking categories along with the size or number of features in the object being categorized, are passed to a confidence assignment process. This determines a value for the confidence in the top category based on the evidence afforded by the input parameters. The magnitude of this confidence value will determine whether the system can accept the automatic categorization results, or whether human involvement is required. This invention also describes the process of determining the optimal value of an internal scaling parameter in the confidence assignment process. The construction of a threshold table based on this parameter is also described. The threshold table matches confidence values against error levels. For a given error rate the previously assigned confidence determines whether the categorization results can be accepted without need for human intervention. This invention maximizes the number of objects that can be automatically processed, for a given error rate.
A computer system for determining a confidence level of a category of one or more documents, comprising:
A method of verifying categorization of one or more documents, the method comprising the steps of:
A system for verifying categorization of one or more documents, the system comprising:
Dependencies are inferred from the claim text.