# US 2024/0177071 A1 · System, Method, and Computer Program Product to Compare Machine Learning Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177071 A1
- Document ID: US20240177071A1
- Status: Published application
- Kind: A1
- Application number: 18/281,663
- Filed: 2022-03-30
- Published: 2024-05-30
- Earliest claimed: 2021-03-30
- Assignees: Visa International Service Association
- Applicants: Visa International Service Association
- Inventors: Junpeng Wang; Liang Wang; Yan Zheng; Michael Yeh; Shubham Jain; Wei Zhang; Zhongfang Zhuang; Hao Yang
- Web page: https://patentgrep.com/patent/US20240177071A1

## CPC

- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 20/20: Ensemble learning
- G06F 18/2415: based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202)
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Systems, methods, and computer program products may compare machine learning models by identifying data instances with disagreed predictions and learning from the disagreement. Based on a model interpretation technique, differences between the compared machine learning models may be interpreted. Multiple metrics to prioritize meta-features from different perspectives may also be provided.

## Claims

### Claim 1

A system for comparing machine learning models, the system comprising:
at least one processor programmed or configured to:
receive a dataset of data instances, wherein each data instance comprises a feature value for each feature of a plurality of features;
generate outputs of a first machine learning model and outputs of a second machine learning model based on the dataset of data instances;
determine a first subset of the outputs of the first machine learning model and a second subset of outputs of the second machine learning model;
generate a disagreement matrix that includes a first set of grouped outputs of the first machine learning model and the second machine learning model and a second set of grouped outputs of the first machine learning model and the second machine learning model, wherein the first set of grouped outputs comprises a plurality of outputs of the first machine learning model that satisfies a first condition and a plurality of outputs of the second machine learning model that does not satisfy the first condition, and wherein the second set of grouped outputs comprises a plurality of outputs of the first machine learning model that does not satisfy the first condition and a plurality of outputs of the second machine learning model that satisfies the first condition;
generate a plurality of true label matrices based on true labels of the first set of grouped outputs and the second set of grouped outputs, wherein a first true label matrix includes true positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and true positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition, and wherein a second true label matrix includes false positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and false positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition;
train a first classifier based on the first true label matrix;
train a second classifier based on the second true label matrix; and
determine an accuracy of the first machine learning model and an accuracy of the second machine learning model based on the first classifier and the second classifier.

### Claim 2 (depends on 1)

The system of claim 1, wherein the first subset of the outputs of the first machine learning model and the second subset of outputs of the second machine learning model have a same number of values.

### Claim 3 (depends on 1)

The system of claim 1, wherein when determining the accuracy of the first machine learning model and the accuracy of the second machine learning model, the at least one processor is programmed or configured to:
determine the accuracy of the first machine learning model and the accuracy of the second machine learning model based on a model interpretation technique that is performed on the first classifier and the second classifier.

### Claim 4 (depends on 3)

The system of claim 3, wherein the model interpretation technique is a model interpretation technique that involves Shapley additive explanations (SHAP) values.

### Claim 5 (depends on 4)

The system of claim 4, wherein when determining the accuracy of the first machine learning model and the accuracy of the second machine learning model, the at least one processor is programmed or configured to:
calculate a SHAP value for each feature value of each data instance of the dataset for the first classifier; and
calculate a SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim 6 (depends on 5)

The system of claim 5, wherein when determining the accuracy of the first machine learning model and the accuracy of the second machine learning model, the at least one processor is programmed or configured to:
generate a plot of the SHAP value for each feature value of each data instance of the dataset for the first classifier and the SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim 7 (depends on 5)

The system of claim 5, wherein when determining the accuracy of the first machine learning model and the accuracy of the second machine learning model, the at least one processor is programmed or configured to:
generate a plot of a plurality of SHAP values for a plurality of feature values of a first feature of each data instance of the dataset for the first classifier and a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the second classifier.

### Claim 8 (depends on 5)

The system of claim 5, wherein when determining the accuracy of the first machine learning model and the accuracy of the second machine learning model, the at least one processor is programmed or configured to:
calculate an accuracy metric value associated with an accuracy metric of a first feature for the first classifier, wherein the accuracy metric value associated with the accuracy metric of the first feature for the first classifier is based on a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the first classifier; and
calculate an accuracy metric value associated with the accuracy metric of the first feature for the second classifier, wherein the accuracy metric value associated with the accuracy metric of the first feature for the second classifier is based on a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the second classifier,
wherein the accuracy metric comprises a metric associated with a measure of magnitude of a feature, a metric associated with a measure of consistency of a feature, a metric associated with a measure of contrast of a feature, or a metric associated with a measure of correlation of a feature.

### Claim 9

A computer-implemented method, comprising:
receiving, with at least one processor, a dataset of data instances, wherein each data instance comprises a feature value for each feature of a plurality of features;
generating, with the at least one processor, outputs of a first machine learning model and outputs of a second machine learning model based on the dataset of data instances;
determining, with the at least one processor, a first subset of the outputs of the first machine learning model and a second subset of outputs of the second machine learning model;
generating, with the at least one processor, a disagreement matrix that includes a first set of grouped outputs of the first machine learning model and the second machine learning model and a second set of grouped outputs of the first machine learning model and the second machine learning model, wherein the first set of grouped outputs comprises a plurality of outputs of the first machine learning model that satisfies a first condition and a plurality of outputs of the second machine learning model that does not satisfy the first condition, and wherein the second set of grouped outputs comprises a plurality of outputs of the first machine learning model that does not satisfy the first condition and a plurality of outputs of the second machine learning model that satisfies the first condition;
generating, with the at least one processor, a plurality of true label matrices based on true labels of the first set of grouped outputs and the second set of grouped outputs, wherein a first true label matrix includes true positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and true positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition, and wherein a second true label matrix includes false positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and false positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition;
training, with the at least one processor, a first classifier based on the first true label matrix;
training, with the at least one processor, a second classifier based on the second true label matrix; and
determining, with the at least one processor, an accuracy of the first machine learning model and an accuracy of the second machine learning model based on the first classifier and the second classifier.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the first subset of the outputs of the first machine learning model and the second subset of outputs of the second machine learning model have a same number of values.

### Claim 11 (depends on 9)

The computer-implemented method of claim 9, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
determining the accuracy of the first machine learning model and the accuracy of the second machine learning model based on a model interpretation technique that is performed on the first classifier and the second classifier.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the model interpretation technique is a model interpretation technique that involves Shapley additive explanations (SHAP) values.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
calculating a SHAP value for each feature value of each data instance of the dataset for the first classifier; and
calculating a SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim 14 (depends on 13)

The computer-implemented method of claim 13, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
generating a plot of the SHAP value for each feature value of each data instance of the dataset for the first classifier and the SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim 15 (depends on 13)

The computer-implemented method of claim 13, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
generating a plot of a plurality of SHAP values for a plurality of feature values of a first feature of each data instance of the dataset for the first classifier and a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the second classifier.

### Claim 16 (depends on 13)

The computer-implemented method of claim 13, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
calculating an accuracy metric value associated with an accuracy metric of a first feature for the first classifier, wherein the accuracy metric value associated with the accuracy metric of the first feature for the first classifier is based on a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the first classifier; and
calculating an accuracy metric value associated with the accuracy metric of the first feature for the second classifier, wherein the accuracy metric value associated with the accuracy metric of the first feature for the second classifier is based on a plurality of SHAP values for a plurality of feature values of the first feature of each data instance of the dataset for the second classifier,
wherein the accuracy metric comprises a metric associated with a measure of magnitude of a feature, a metric associated with a measure of consistency of a feature, a metric associated with a measure of contrast of a feature, or a metric associated with a measure of correlation of a feature.

### Claim 17

A computer program product comprising at least one non-transitory computer-readable medium including program instructions that, when executed by at least one processor, cause the at least one processor to:
receive a dataset of data instances, wherein each data instance comprises a feature value for each feature of a plurality of features;
generate outputs of a first machine learning model and outputs of a second machine learning model based on the dataset of data instances;
determine a first subset of the outputs of the first machine learning model and a second subset of outputs of the second machine learning model;
generate a disagreement matrix that includes a first set of grouped outputs of the first machine learning model and the second machine learning model and a second set of grouped outputs of the first machine learning model and the second machine learning model, wherein the first set of grouped outputs comprises a plurality of outputs of the first machine learning model that satisfies a first condition and a plurality of outputs of the second machine learning model that does not satisfy the first condition, and wherein the second set of grouped outputs comprises a plurality of outputs of the first machine learning model that does not satisfy the first condition and a plurality of outputs of the second machine learning model that satisfies the first condition;
generate a plurality of true label matrices based on true labels of the first set of grouped outputs and the second set of grouped outputs, wherein a first true label matrix includes true positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and true positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition, and wherein a second true label matrix includes false positive outputs of the plurality of outputs of the first machine learning model that satisfy the first condition and false positive outputs of the plurality of outputs of the second machine learning model that satisfy the first condition;
train a first classifier based on the first true label matrix;
train a second classifier based on the second true label matrix; and
determine an accuracy of the first machine learning model and an accuracy of the second machine learning model based on the first classifier and the second classifier.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the first subset of the outputs of the first machine learning model and the second subset of outputs of the second machine learning model have a same number of values.

### Claim 19 (depends on 17)

The computer program product of claim 17, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
determining the accuracy of the first machine learning model and the accuracy of the second machine learning model based on a model interpretation technique that is performed on the first classifier and the second classifier,
wherein the model interpretation technique is a model interpretation technique that involves Shapley additive explanations (SHAP) values, and
wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
calculating a SHAP value for each feature value of each data instance of the dataset for the first classifier; and
calculating a SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein determining the accuracy of the first machine learning model and the accuracy of the second machine learning model includes:
generating a plot of the SHAP value for each feature value of each data instance of the dataset for the first classifier and the SHAP value for each feature value of each data instance of the dataset for the second classifier.

### Claim at position 21

-22. (canceled)
