System and method for evaluating and deploying data models having improved performance measures

One or more non-transitory computer-readable media having computer-executable instructions embodied thereon that, when executed, perform a method for evaluating and/or improving data model version performance and accuracy, the method comprising:

• receiving a plurality of datasets for a plurality of versions of a data model, wherein each of the plurality of datasets includes a plurality of predictions of a corresponding version of the data model in the plurality of versions of the data model;
• receiving a configuration file and a mapping file;
• generating a plurality of version-performance reports from the plurality of datasets based on the configuration file and the mapping file, wherein each of the plurality of version-performance reports of the plurality of versions of the data model includes a plurality of performance measures determined for the corresponding version of the data model in the plurality of versions of the data model;
• receiving a baseline file;
• validating the plurality of version-performance reports of the plurality of versions of the data model based on the baseline file;
• determining a leading version of the data model in the plurality of versions of the data model based on a corresponding version-performance report of the leading version of the data model in the plurality of versions of the data model indicating that the leading version of the data model in the plurality of versions of the data model has improved performance and/or accuracy relative to at least one other version in the plurality of versions of the data model;
• and
• deploying the leading version of the data model in the plurality of versions of the data model to replace a currently in-use version of the data model in the plurality of versions of the data model.

A system for evaluating and improving model version performance and/or accuracy, the system comprising:

• one or more processors;
• a data model performance monitoring system that, via the one or more processors executing a script:
• receives a plurality of datasets for a plurality of versions of a data model, wherein each of the plurality of datasets includes a plurality of predictions of a corresponding version of the data model in the plurality of versions of the data model;
• receives a configuration file and a mapping file;
• generates a plurality of version-performance reports from the plurality of datasets based on the configuration file and the mapping file, wherein each of the plurality of version-performance reports of the plurality of versions of the data model includes a plurality of performance measures determined for the corresponding version of the data model in the plurality of versions of the data model;
• receives a baseline file;
• and
• validates the plurality of version-performance reports of the plurality of versions of the data model based on the baseline file;
• and
• a monitoring dashboard module that, via the one or more processors executing a script:
• determines a leading version of the data model in the plurality of versions of the data model based on a corresponding plurality of performance measures in a version-performance report of the leading version of the data model in the plurality of versions of the data model relative to the plurality of version-performance reports of the plurality of versions of the data model, wherein a corresponding version-performance report of the leading version of the data model in the plurality of versions of the data model indicates that the leading version of the data model in the plurality of versions of the data model has improved performance and/or accuracy relative to other versions in the plurality of versions of the data model;
• and
• deploys the leading version of the data model in the plurality of versions of the data model to replace a currently in-use version of the data model in the plurality of versions of the data model.