Mapping and quantification of influence of neural network features for explainable artificial intelligence

One or more non-transitory computer-readable storage mediums having stored thereon executable computer program instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• determining support from one or more features associated with a plurality of layers of a neural network for one or more inference decisions by the neural network;
• determining a strength of support for each of the one or more inference decisions;
• identifying one or more inference decisions with low stability based at least in part on the determined strength of support for the one or more inference decisions;
• and
• reevaluating the one or more inference decisions that are identified as having low stability.

A method comprising:

• evaluating of contribution of lower level features to higher level features in a neural network, the neural network having a plurality of neural network layers including an input layer, at least one lower level, at least one higher level, and an output layer, the evaluation including one or more of:
• identification of links between lower level and higher level features of the neural network, and
• quantification of contribution of lower level features to higher level features of the neural network;
• and
• adjusting weight associated with the at least one higher level of the neural network based on the evaluation of the contribution.

A system comprising:

• one or more processors to process data;
• and
• a memory to store data, including data for neural network analysis;
• wherein the system is to:
• determine support from one or more features associated with a plurality of layers of a neural network for one or more inference decisions by the neural network;
• determine a strength of support for each of the one or more inference decisions;
• identify one or more inference decisions that have low stability based at least in part on the determined strength of support for the one or more inference decisions;
• and
• reevaluate the one or more inference decisions that are identified as having low stability.