Managing multiple data mining scoring results

A method for managing model scoring results in a data mining environment, the data mining environment having a data mining tool and a data mining model, wherein the data mining tool scores scoring input data sets using the data mining model to produce scoring output data and store the scoring output data in records in model scoring results tables, the method comprising the steps of:

• registering the model scoring results tables in a model scoring results control table, wherein the registering includes model scoring results table metadata, the model scoring results control table further comprising a name for each data mining model used for scoring, a name for each input data set used for scoring, a name for each registered model scoring results table, and a scoring status indicating whether the registered model scoring results control table is actively used;
• selecting, from among the model scoring results tables a selected model scoring results table, wherein the selecting is carried out in dependence upon metadata from the model scoring results control table;
• reading a scoring output data record from the selected registered model scoring results table;
• and
• storing the scoring output data record in a managed representation table, the managed representation table further comprising an identification number for each record in each selected registered model scoring results table, a name for each data mining model used for scoring, and a name for each scoring input data set,
• and further wherein each registered model scoring results table further comprises a record identification number column in which is stored an identification number for each record in the model scoring results table, and the managed representation table further comprises a record identification column in which the identification number for each record from each selected registered model scoring results table is stored, the identification numbers being those identification numbers stored in the model scoring results table record identification column,
• and further wherein the data mining model is a clustering model and the data mining tool scores scoring input data sets using the clustering model to produce scoring output data records, to establish clusters, to select from the clusters a best fitting cluster and a second best fitting cluster, to score the fitting quality of each record to the best fitting cluster, to score the fitting quality of each record to the second best fitting cluster, and to establish a confidence value of the cluster assignment of each record, the managed representation table further comprising for each record a numerical index for the best fitting cluster, a score of the fitting quality of the record to the best fitting cluster, a numerical index for the second best fitting cluster, a score of the fitting quality of the record to the second best filling cluster, and a confidence value of the cluster assignment of the record.

A system for managing model scoring results in a data mining environment, the data mining environment having a data mining tool and a data mining model, wherein the data mining tool scores scoring input data sets using the data mining model to produce scoring output data and store the scoring output data in records in model scoring results tables, the system comprising:

• means for registering the model scoring results tables in a model scoring results control table, wherein the registering includes model scoring results table metadata;
• means for selecting, from among the model scoring results tables a selected model scoring results table, wherein the selecting is carried out in dependence upon metadata from the model scoring results control table;
• means for reading a scoring output data record from the selected registered model scoring results table;
• and
• means for storing the scoring output data record in a managed representation table.

A computer program product for managing model scoring results in a data mining environment, the data mining environment having a data mining tool and a data mining model, wherein the data mining tool scores scoring input data sets using the data mining model to produce scoring output data and store the scoring output data in records in model scoring results tables, the computer program product comprising:

• a recording medium;
• means, recorded on the recording medium, for registering the model scoring results tables in a model scoring results control table, wherein the registering includes model scoring results table metadata;
• means, recorded on the recording medium, for selecting, from among the model scoring results tables a selected model scoring results table, wherein the selecting is carried out in dependence upon metadata from the model scoring results control table;
• means, recorded on the recording medium, for reading a scoring output data record from the selected registered model scoring results table;
• and
• means, recorded on the recording medium, for storing the scoring output data record in a managed representation table.