Correcting a machine learning model
AssigneeMicrosoft Technology Licensing, LLC
InventorsRyutaro TANNO, Aditya NORI, Melanie Fernandez PRADIER, Yingzhen LI
Life of this patent
Estimating the term…
Abstract
A computer-implemented method includes receiving an incorrect prediction output by a trained machine learning model, which has been trained using training data items. The method includes identifying a training data item used to train the model that is a cause of the incorrect prediction, by determining an impact on performance of the trained machine learning model associated with removing the training data item from the plurality of training data. The trained model can then be updated to remove the effect of the identified training data item, allowing the model to be automatically corrected in view of poor quality training data.
Claims20
A system comprising a processor and a memory, the memory storing computer-readable instructions that, when executed by the processor, cause the system to:
- receive an incorrect prediction of a trained machine learning model, the trained machine learning model based on a plurality of training data items;
- select a training data item of the plurality of training data items;
- calculate an estimate of an impact on performance of the trained machine learning model in respect of the incorrect prediction, the impact caused by removing the selected training data item from the plurality of training data items;
- determine that the impact on performance indicates an improvement in performance of the trained machine learning model;
- identify the selected training data as a cause of the incorrect prediction based on the calculated estimate of the impact on performance indicating improvement in performance of the trained machine learning model;
- and
- update the trained machine learning model to remove an effect of the selected training data item.
A computer-implemented method comprising:
- receiving an incorrect prediction of a trained machine learning model, the trained machine learning model based on a plurality of training data items;
- selecting a training data item of the plurality of training data items;
- calculating an estimate of an impact on performance of the trained machine learning model in respect of the incorrect prediction, the impact caused by removing the selected training data item from the plurality of training data items;
- determining that the impact on performance indicates an improvement in performance of the trained machine learning model;
- and
- identifying the selected training data as a cause of the incorrect prediction based on the calculated estimate of the impact on performance indicating improvement in performance of the trained machine learning model.
A tangible non-transient computer-readable storage medium having recorded thereon instructions that, when executed by a computer device cause the computer device to:
- receive an incorrect prediction of a trained machine learning model, the trained machine learning model based on a plurality of training data items;
- select a training data item of the plurality of training data items;
- calculate an estimate of an impact on performance of the trained machine learning model in respect of the incorrect prediction, the impact caused by removing the selected training data item from the plurality of training data items;
- determine that the impact on performance indicates an improvement in performance of the trained machine learning model;
- and
- identify the selected training data as a cause of the incorrect prediction based on the calculated estimate of the impact on performance indicating improvement in performance of the trained machine learning model.
Dependencies are inferred from the claim text.