Misuse index for explainable artificial intelligence in computing environments
AssigneeIntel Corporation
InventorsGlen Anderson, Rajesh Poornachandran, Kshitij Arun Doshi
Life of this patent
Estimating the term…
Abstract
A mechanism is described for facilitating misuse index for explainable artificial intelligence in computing environments, according to one embodiment. A method of embodiments, as described herein, includes mapping training data with inference uses in a machine learning environment, where the training data is used for training a machine learning model. The method may further include detecting, based on one or more policy/parameter thresholds, one or more discrepancies between the training data and the inference uses, classifying the one or more discrepancies as one or more misuses, and creating a misuse index listing the one or more misuses.
Claims20
A method, comprising:
- obtaining, based on a policy for a neural network, a threshold value for detecting whether the neural network is misused;
- adjusting the threshold value based on a change associated with the policy;
- determining a misuse index value from training data and inference data of the neural network, the training data used to train the neural network, the inference data generated from inference of the neural network;
- and
- modifying the neural network based on a comparison of the adjusted threshold value and the misuse index value.
One or more non-transitory computer-readable media storing instructions executable to perform operations, the operations comprising:
- obtaining, based on a policy for a neural network, a threshold value for detecting whether the neural network is misused;
- adjusting the threshold value based on a change associated with the policy;
- determining a misuse index value from training data and inference data of the neural network, the training data used to train the neural network, the inference data generated from inference of the neural network;
- and
- modifying the neural network based on a comparison of the adjusted threshold value and the misuse index value.
An apparatus, comprising:
- a computer processor for executing computer program instructions;
- and
- a non-transitory computer-readable memory storing computer program instructions executable by the computer processor to perform operations comprising:
- obtaining, based on a policy for a neural network, a threshold value for detecting whether the neural network is misused,
- adjusting the threshold value based on a change associated with the policy,
- determining a misuse index value from training data and inference data of the neural network, the training data used to train the neural network, the inference data generated from inference of the neural network, and
- modifying the neural network based on a comparison of the adjusted threshold value and the misuse index value.
Dependencies are inferred from the claim text.