US 2025/0165798 A1Published application

Model training for datasets having data shifts

AssigneeCapital One Services, LLC

InventorsYoubing YIN, Joshua EDWARDS, Benjamin ENG

Life of this patent

Estimating the term…

Loading patent…

Abstract

Methods and systems are described herein for facilitating model training related to data shifts. The system may detect, in a production dataset, a data shift from a training dataset used to train a machine learning model. The system may provide the training dataset and the production dataset to an adversarial network to train a first classifier and a second classifier, respectively. The system may provide synthetic data derived from the production dataset to the adversarial network to cause the first classifier and the second classifier to classify the synthetic data. Based on the classifications received from the adversarial network, the system may exclude the synthetic data from an updated training dataset for updating the machine learning model.

Claims20

Dependent claims

A system for reducing compute resource usage for model training related to data shifts by excluding synthetic data from training datasets that is not representative of the data shifts, the system comprising:

one or more processors and one or more non-transitory computer-readable media having computer-executable instructions stored thereon, the computer-executable instructions, when executed by the one or more processors, causing operations comprising:
detecting, in a production dataset, a data shift from a training dataset used to train a machine learning model;
providing, to a first generative adversarial classifier, the training dataset to train the first generative adversarial classifier to classify whether data belongs to the training dataset;
providing, to a second generative adversarial classifier, the production dataset to train the second generative adversarial classifier to classify whether data belongs to a subset of the production dataset that corresponds to the data shift;
providing, to a generative adversarial generator, the production dataset to cause the generative adversarial generator to generate synthetic data for potential inclusion in an updated training dataset for training the machine learning model;
providing, to the first generative adversarial classifier and the second generative adversarial classifier, the synthetic data to cause the first generative adversarial classifier and the second generative adversarial classifier to classify the synthetic data;
in response to the first generative adversarial classifier indicating that the synthetic data belongs to the training dataset and the second generative adversarial classifier indicating that the synthetic data belongs to the subset corresponding to the data shift, excluding the synthetic data from the updated training dataset;
and
in connection with detecting the data shift in the production dataset, updating the machine learning model using the updated training dataset that excludes the synthetic data generated via the generative adversarial generator.

6 more elements

A method comprising:

detecting, in a production dataset, a data shift from a training dataset used to train a machine learning model;
providing, to a generative adversarial network comprising a first classifier and a second classifier, the training dataset to train the first classifier and the production dataset to train the second classifier;
providing, to the generative adversarial network, synthetic data derived from the production dataset to cause the first classifier and the second classifier to classify the synthetic data;
receiving, from the generative adversarial network, a first classification for the synthetic data from the first classifier and from the second classifier;
and
in response to receiving the first classification for the synthetic data from the first classifier and from the second classifier, excluding the synthetic data from an updated training dataset for updating the machine learning model.

3 more elements

One or more non-transitory, computer-readable media storing instructions that, when executed by one or more processors, cause operations comprising:

detecting, in a second dataset, a data shift from a first dataset used to train a machine learning model;
providing, to a generative adversarial network comprising a first classifier and a second classifier, the first dataset to train the first classifier and the second dataset to train the second classifier;
obtaining, via the first classifier and the second classifier, a first classification of synthetic data derived from the second dataset;
and
in response to obtaining the first classification via the first classifier and the second classifier, excluding the synthetic data from an updated first dataset for updating the machine learning model.

2 more elements

Dependencies are inferred from the claim text.