# US 2025/0165864 A1 · Methods and Systems for Re-training a Machine Learning Model Using Predicted Features from Training Dataset

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165864 A1
- Document ID: US20250165864A1
- Status: Published application
- Kind: A1
- Application number: 18/948,401
- Filed: 2024-11-14
- Published: 2025-05-22
- Earliest claimed: 2023-11-20
- Assignees: Mastercard International Incorporated
- Applicants: Mastercard International Incorporated
- Inventors: Soumyadeep Ghosh; Harsimran Bhasin; Maneet Singh
- Web page: https://patentgrep.com/patent/US20250165864A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Methods and systems for re-training a Machine Learning (ML) model using predicted features from a training dataset are disclosed. A method performed by a server system includes accessing a training feature set and a testing feature set from a database. In response to identifying an inclusion of at least one new feature in the testing feature set, the method includes training a surrogate ML model to predict a value for the new feature based on the testing feature set and determining, by the surrogate ML model, a predicted value for the new feature for each training data sample in a training dataset based on the training feature set. The method further includes generating a new training feature set for each training data sample based on the predicted value and the training feature set. The method includes re-training the ML model based on the new training feature for each data sample.

## Claims

### Claim 1

A computer-implemented method, comprising:
accessing, by a server system, a training feature set and a testing feature set from a database associated with the server system, the training feature set associated with each training data sample in a training dataset and the testing feature set associated with each testing data sample in a testing dataset;
in response to determining an inclusion of at least one new feature in the testing feature set, training, by the server system, a surrogate Machine Learning (ML) model to predict a value corresponding to the at least one new feature based, at least in part, on the testing feature set;
determining, by the surrogate ML model, a predicted value corresponding to the at least one new feature for each training data sample in the training dataset based, at least in part, on the training feature set;
generating, by the server system, a new training feature set for each training data sample based, at least in part, on the corresponding predicted value and the corresponding training feature set; and
re-training, by the server system, an ML model based, at least in part, on the new training feature set for each training data sample to obtain a re-trained ML model.

### Claim 2 (depends on 1)

The computer-implemented method as claimed in claim 1, further comprising:
training, by the server system, the ML model to perform a predefined task based, at least in part, on the training feature set and a corresponding ground truth label associated with each training data sample.

### Claim 3 (depends on 2)

The computer-implemented method as claimed in claim 2, wherein training the ML model comprises performing iteratively until first convergence criteria are met, a first set of operations comprising:
initializing the ML model based, at least in part, on the training feature set and one or more first model parameters;
generating, by the ML model, a predicted probability score for each training data sample in the training dataset based, at least in part, on the training feature set and the one or more first model parameters, the predicted probability score indicating a likelihood of performing the predefined task;
generating, by the ML model, a prediction for the predefined task based, at least in part, on the predicted probability score and a task threshold, the prediction comprising a label associated with the predefined task;
computing, by the ML model, a loss for each training data sample in the training dataset based, at least in part, on the prediction, the corresponding ground truth label, and a loss function; and
optimizing the one or more first model parameters based, at least in part, on the loss.

### Claim 4 (depends on 1)

The computer-implemented method as claimed in claim 1, further comprising:
accessing, by the server system, an input dataset from the database, the input dataset comprising a plurality of data samples associated with a plurality of users, and split into the training dataset recorded for a training period of the ML model and the testing dataset recorded for a testing period of the ML model;
generating, by the server system, a plurality of features for each data sample of the plurality of data samples based, at least in part, on the input dataset, the plurality of features comprising the training feature set generated for the training period and the testing feature set generated for the testing period of the ML model; and
storing, by the server system, the plurality of features for each data sample in the database.

### Claim 5 (depends on 1)

The computer-implemented method as claimed in claim 1, wherein training the surrogate ML model comprises performing iteratively until second convergence criteria are met, a second set of operations comprising:
initializing the surrogate ML model based, at least in part, on the testing feature set and one or more second model parameters;
generating, by the surrogate ML model, a predicted probability score for each testing data sample in the testing dataset based, at least in part, on the testing feature set and the one or more second model parameters, the predicted probability score indicating a likelihood of predicting the value for the at least one new feature;
generating, by the surrogate ML model, a prediction for the value corresponding to the at least one new feature based, at least in part, on the predicted probability score and a threshold, the prediction comprising the value for the at least one new feature;
computing, by the surrogate ML model, a loss for each testing data sample in the testing dataset based, at least in part, on the prediction, the identified at least one new feature, and a loss function; and
optimizing the one or more second model parameters based, at least in part, on the loss.

### Claim 6 (depends on 1)

The computer-implemented method as claimed in claim 1, wherein re-training the ML model comprises performing iteratively until third convergence criteria are met, a third set of operations comprising:
initializing the ML model based, at least in part, on the new training feature set, a corresponding ground truth label associated with each training data sample, and one or more first model parameters;
generating, by the ML model, a new predicted probability score for each training data sample in the training dataset based, at least in part, on the new training feature set and the one or more first model parameters, the new predicted probability score indicating a likelihood of performing the predefined task;
generating, by the ML model, a new prediction for the predefined task based, at least in part, on the new predicted probability score and a task threshold, the new prediction comprising a new label associated with the predefined task;
computing, by the ML model, a loss for each training data sample in the training dataset based, at least in part, on the new prediction, the corresponding ground truth label, and a loss function; and
optimizing the one or more first model parameters based, at least in part, on the loss.

### Claim 7 (depends on 1)

The computer-implemented method as claimed in claim 1, further comprising:
receiving, by the server system, a prediction request related to a predefined task from a user;
generating, by the re-trained ML model associated with the server system, a new prediction corresponding to the predefined task based, at least in part, on the testing feature set for each testing data sample, the testing feature set comprising the at least one new feature; and
transmitting, by the server system, the new prediction to the user.

### Claim 8 (depends on 1)

The computer-implemented method as claimed in claim 1, further comprising:
computing, by the server system, a first performance metric associated with the ML model based, at least in part, on the testing feature set;
computing, by the server system, a second performance metric associated with the re-trained ML model based, at least in part, on the testing feature set; and
computing, by the server system, an improvisation factor based, at least in part, on the first performance metric and the second performance metric, the improvisation factor indicating an extent of a positive impact on performance of the ML model due to the re-training process.

### Claim 9 (depends on 1)

The computer-implemented method as claimed in claim 1, further comprising:
identifying, by the server system, a relationship between the at least one new feature and the testing feature set based, at least in part, on the testing feature set; and
in response to identifying that the relationship corresponds to a non-linear relationship, training, by the server system, the surrogate ML model to predict the value corresponding to the at least one new feature.

### Claim 10 (depends on 9)

The computer-implemented method as claimed in claim 9, further comprising:
in response to identifying that the relationship corresponds to a linear relationship, discarding, by the server system, the at least one new feature for training the surrogate ML model.

### Claim 11

A server system, comprising:
a communication interface;
a memory comprising executable instructions; and
a processor communicably coupled to the communication interface and the memory, the processor configured to cause the server system to at least:
access a training feature set and a testing feature set from a database associated with the server system, the training feature set is associated with each training data sample in a training dataset and the testing feature set is associated with each testing data sample in a testing dataset;
in response to determining an inclusion of at least one new feature in the testing feature set, train a surrogate Machine Learning (ML) model to predict a value corresponding to the at least one new feature based, at least in part, on the testing feature set;
determine, by the surrogate ML model, a predicted value corresponding to the at least one new feature for each training data sample in the training dataset based, at least in part, on the training feature set;
generate a new training feature set for each training data sample based, at least in part, on the corresponding predicted value and the corresponding training feature set; and
re-train an ML model based, at least in part, on the new training feature set for each training data sample to obtain a re-trained ML model.

### Claim 12 (depends on 11)

The server system as claimed in claim 11, wherein the server system is further caused, at least in part, to train the ML model to perform a predefined task based, at least in part, on the training feature set and a corresponding ground truth label associated with each training data sample.

### Claim 13 (depends on 12)

The server system as claimed in claim 12, wherein to train the ML model, the server system is further caused, at least in part, to perform iteratively until first convergence criteria are met, a first set of operations comprising:
initializing the ML model based, at least in part, on the training feature set and one or more first model parameters;
generating, by the ML model, a predicted probability score for each training data sample in the training dataset based, at least in part, on the training feature set and the one or more first model parameters, the predicted probability score indicating a likelihood of performing the predefined task;
generating, by the ML model, a prediction for the predefined task based, at least in part, on the predicted probability score and a task threshold, the prediction comprising a label associated with the predefined task;
computing, by the ML model, a loss for each training data sample in the training dataset based, at least in part, on the prediction, the corresponding ground truth label, and a loss function; and
optimizing the one or more first model parameters based, at least in part, on the loss.

### Claim 14 (depends on 11)

The server system as claimed in claim 11, wherein the server system is further caused, at least in part, to:
access the input dataset from the database, the input dataset comprising a plurality of data samples associated with a plurality of users, and split into the training dataset recorded for a training period of the ML model and the testing dataset recorded for a testing period of the ML model;
generate a plurality of features for each data sample of the plurality of data samples based, at least in part, on the input dataset, the plurality of features comprising the training feature set generated for the training period and the testing feature set generated for the testing period of the ML model; and
store the plurality of features for each data sample in the database.

### Claim 15 (depends on 11)

The server system as claimed in claim 11, wherein to train the surrogate ML model, the server system is further caused, at least in part, to perform iteratively until second convergence criteria are met, a second set of operations comprising:
initializing the surrogate ML model based, at least in part, on the testing feature set and one or more second model parameters;
generating, by the surrogate ML model, a predicted probability score for each testing data sample in the testing dataset based, at least in part, on the testing feature set and the one or more second model parameters, the predicted probability score indicating a likelihood of predicting the value for the at least one new feature;
generating, by the surrogate ML model, a prediction for the value corresponding to the at least one new feature based, at least in part, on the predicted probability score and a threshold, the prediction comprising the value for the at least one new feature;
computing, by the surrogate ML model, a loss for each testing data sample in the testing dataset based, at least in part, on the prediction, the identified at least one new feature, and a loss function; and
optimizing the one or more second model parameters based, at least in part, on the loss.

### Claim 16 (depends on 11)

The server system as claimed in claim 11, wherein to re-train the ML model, the server system is further caused, at least in part, to perform iteratively until third convergence criteria are met, a third set of operations comprising:
initializing the ML model based, at least in part, on the new training feature set, a corresponding ground truth label associated with each training data sample and one or more first model parameters;
generating, by the ML model, a new predicted probability score for each training data sample in the training dataset based, at least in part, on the new training feature set and the one or more first model parameters, the new predicted probability score indicating a likelihood of performing the predefined task;
generating, by the ML model, a new prediction for the predefined task based, at least in part, on the predicted probability score and a task threshold, the new prediction comprising a new label associated with the predefined task;
computing, by the ML model, a loss for each training data sample in the training dataset based, at least in part, on the new prediction, the corresponding ground truth label, and a loss function; and
optimizing the one or more first model parameters based, at least in part, on the loss.

### Claim 17 (depends on 11)

The server system as claimed in claim 11, wherein the server system is further caused, at least in part, to:
receive a prediction request related to a predefined task from a user;
generate, by a re-trained ML model associated with the server system, a new prediction corresponding to the predefined task based, at least in part, on the testing feature set for each testing data sample, the testing feature set comprising the at least one new feature; and
in response to the prediction request, transmit the new prediction to the user.

### Claim 18 (depends on 11)

The server system as claimed in claim 11, wherein the server system is further caused, at least in part, to:
compute a first performance metric associated with the ML model based, at least in part, on the testing feature set;
compute a second performance metric associated with the re-trained ML model based, at least in part, on the testing feature set; and
compute an improvisation factor based, at least in part, on the first performance metric and the second performance metric, the improvisation factor indicating an extent of a positive impact on performance of the ML model due to the re-training process.

### Claim 19 (depends on 11)

The server system as claimed in claim 11, wherein the server system is further caused, at least in part, to:
identify a relationship between the at least one new feature and the testing feature set based, at least in part, on the testing feature set;
in response to identifying that the relationship corresponds to a non-linear relationship, train the surrogate ML model to predict the value corresponding to the at least one new feature; and
in response to identifying that the relationship corresponds to a linear relationship, discard the at least one new feature for training the surrogate ML model.

### Claim 20

A non-transitory computer-readable storage medium comprising computer-executable instructions that, when executed by at least a processor of a server system, cause the server system to perform a method comprising:
accessing a training feature set and a testing feature set from a database associated with the server system, the training feature set is associated with each training data sample in a training dataset and the testing feature set is associated with each testing data sample in a testing dataset;
in response to determining an inclusion of at least one new feature in the testing feature set, training a surrogate Machine Learning (ML) model to predict a value corresponding to the at least one new feature based, at least in part, on the testing feature set;
determining, by the surrogate ML model, a predicted value corresponding to the at least one new feature for each training data sample in the training dataset based, at least in part, on the training feature set;
generating a new training feature set for each training data sample based, at least in part, on the corresponding predicted value and the corresponding training feature set; and
re-training an ML model based, at least in part, on the new training feature set for each training data sample.
