Detecting model deviation with inter-group metrics

A method for detecting inter-group performance deviation of a computer model, comprising:

• identifying a set of model predictions for a set of data samples applied to a trained computer model, each data sample being associated with at least one group of a plurality of groups;
• determining a plurality of group performance metrics, each corresponding to one of the plurality of groups based on the model predictions for data samples associated with the respective group;
• determining an inter-group performance metric for the computer model based on the plurality of group performance metrics;
• determining that the inter-group performance metric exceeds an inter-group performance threshold calibrated based on a plurality of calibration inter-group performance metrics;
• and
• responsive to the determination that the inter-group performance metrics exceeds the inter-group performance threshold, retraining at least one parameter of the computer model to reduce the inter-group performance metric.

A non-transitory computer-readable medium, the non-transitory computer-readable medium comprising instructions executable by a processor for:

• identifying a set of model predictions for a set of data samples applied to a trained computer model, each data sample being associated with at least one group of a plurality of groups;
• determining a plurality of group performance metrics, each corresponding to one of the plurality of groups based on the model predictions for data samples associated with the respective group;
• determining an inter-group performance metric for the computer model based on the plurality of group performance metrics;
• determining that the inter-group performance metric exceeds an inter-group performance threshold calibrated based on a plurality of calibration inter-group performance metrics;
• and
• responsive to the determination that the inter-group performance metrics exceeds the inter-group performance threshold, retraining at least one parameter of the computer model to reduce the inter-group performance metric.