Training data poisoning detection
AssigneeHewlett Packard Enterprise Development LP
InventorsOmer Uretzky, Gil Barash, Amir Idar
Life of this patent
Estimating the term…
Abstract
In some examples, a system receives a plurality of training samples of a training data set for a machine learning model, where each training sample of the plurality of training samples comprises a plurality of features. The system determines quantities of changes made to respective features of the plurality of features, computes a score representing an integrity of the training data set based on the quantities, and detects poisoning of the training data set based on the score.
Claims20
A non-transitory machine-readable storage medium comprising instructions that upon execution cause a system to:
- receive a plurality of training samples of a training data set for a machine learning model, wherein each training sample of the plurality of training samples comprises a plurality of features;
- determine quantities of changes made to respective features of the plurality of features;
- compute a score representing an integrity of the training data set based on the quantities;
- and
- detect poisoning of the training data set based on the score.
A system comprising:
- a processor;
- and
- a non-transitory storage medium storing instructions executable on the processor to:
- receive an input collection of training samples for a training data set, the training data set used for training a machine learning model, wherein each training sample of the input collection of training samples comprises a plurality of features;
- determine quantities of outliers in values of respective features of the plurality of features;
- compute a score representing an integrity of the training data set based on the quantities;
- and
- detect poisoning of the training data set based on the score.
A method comprising:
- receiving an input collection of training samples for a training data set, the training data set used for training a machine learning model, wherein each training sample of the input collection of training samples comprises a plurality of features;
- determining, by a system comprising a hardware processor, quantities of changes made to respective features of the plurality of features;
- determining, by the system, quantities of outliers in values of the respective features;
- computing, by the system, a score representing an integrity of the training data set based on the quantities of changes and the quantities of outliers;
- and
- detecting, by the system, poisoning of the training data set based on the score.
Dependencies are inferred from the claim text.