Latent feature activity constraints for ensuring explainability in interpretable neural network models
AssigneeFair Isaac Corporation
InventorsScott Michael Zoldi, Krzysztof Nalborski
Life of this patent
Estimating the term…
Loading patent…
AssigneeFair Isaac Corporation
InventorsScott Michael Zoldi, Krzysztof Nalborski
Estimating the term…
A method for generating a classifier, comprising: initializing a neural network with a fully connected architecture; applying a regularization constraint to the set of weights between neurons in the input layer and the plurality of latent features in the hidden layer; iteratively reducing a number of incoming connections to each latent feature in the hidden layer to a predetermined number based on the regularized first set of weights; weighting loss function's value based on categories of activation tuples, wherein contributions of data entries with activation tuples of size greater than a predetermined threshold to the loss function's value are limited and wherein contributions of data entries with activation tuples of size “0” to the loss function's value are minimized, to a predefined percentage; and selectively updating sets of weights associated with top-ranked latent features as evaluated by the magnitude of their contributions at the output layer in a training process.
A computer-implemented method for generating a classifier, comprising:
A computer program product comprising a non-transient machine-readable medium storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:
A system comprising:
Dependencies are inferred from the claim text.