System and method for mining model accuracy display
AssigneeMicrosoft Corporation
InventorsPyungchul Kim, Zhaohui Tang, David Earl Heckerman, Scott Conrad Oveson
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Corporation
InventorsPyungchul Kim, Zhaohui Tang, David Earl Heckerman, Scott Conrad Oveson
Estimating the term…
Systems and methods are provided for producing displays of the accuracy of data mining or statistical models that produce associative predictions. For all cases in a testing data set, the model makes predictions and provides associated probabilities. The cases are sorted by their probability of making accurate predictions and a graph is made of the accuracy of the model over various subsets containing the highest probability cases as evaluated by the model. Where a number of probabilities are presented for the predictions in a basket of predictions, those probabilities are combined to yield a probability score for the entire basket. Additionally, the accuracy of a model over different basket sizes may be graphed. The accuracy graph may also be produced for any models making a prediction, by graphing the probability of making accurate predictions and a graph made of the accuracy of the model over various subsets of the data containing the highest probability cases.
A method for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number k of predicted data items associated with said case, where said model produces an associated probability for said predictions, and where said associated data items and said predicted data items are contained in a set of possible associated data items comprising:
A method for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number of predicted data items associated with said case comprising:
A computer-readable medium comprising computer executable modules having computer-executable instructions for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number k of predicted data items associated with said case, where said model produces an associated probability for said predictions, and where said associated data items and said predicted data items are contained in a set of possible associated data items, said modules comprising:
A computer-readable medium comprising computer-executable modules having computer-executable instructions for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number of predicted data items associated with said case, said modules comprising:
A computer device for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number k of predicted data items associated with said case, where said model produces an associated probability for said predictions, and where said associated data items and said predicted data items are contained in a set of possible associated data items, comprising:
A computer device for accuracy display for a model, where, for each case in a testing data set containing one or more associated data items, said model predicts a basket containing a number of predicted data items associated with said case, comprising:
A method for accuracy display for a model where, for each case in a testing data set containing one or more associated data items, where said model makes a prediction regarding each of said cases, where said model produces an associated probability of correctness for each of said predictions, and where the correctness of the predictions can be determined, comprising:
A computer-readable medium comprising computer executable modules having computer-executable instructions for accuracy display for a model where, for each case in a testing data set containing one or more associated data items, where said model makes a prediction regarding each of said cases, where said model produces an associated probability of correctness for each of said predictions, and where the correctness of the predictions can be determined, said modules comprising:
A computer device for accuracy display for a model where, for each case in a testing data set containing one or more associated data items, where said model makes a prediction regarding each of said cases, where said model produces an associated probability of correctness for each of said predictions, and where the correctness of the predictions can be determined, comprising:
Dependencies are inferred from the claim text.