Systems and methods for analysis explainability

A system for displaying attention scores to a user, comprising:

• a database configured to store a source document including a plurality of tokens;
• and
• a server configured to perform operations including:
• receiving the source document;
• applying a model to the source document to generate a summary based on content of the source document;
• determining one or more attention scores for each token of the plurality of tokens of the source document, wherein the one or more attention scores indicates a level of relevance of an associated token to the summary generated by the at least one model;
• aligning each token of the plurality of tokens to at least one word of a plurality of words included in the source document;
• and
• combining, for each word of the plurality of words, attention scores of tokens aligned to the each word to generate an overall attention score for each word of the plurality of words;
• and
• an input/output device configured to display at least one word of the plurality of words with an indication of the overall attention score associated with the at least one word, the indication based on the overall score.

A computer-based tool for displaying attention scores to a user, the computer-based tool including non-transitory computer readable media having stored thereon computer code which, when executed by a processor, causes a computing device to perform operations comprising:

• receiving a source document to be analyzed by at least one model, wherein the source document includes a plurality of tokens, and wherein the at least one model is configured to generate a summary based on content of the source document;
• determining one or more attention scores for each token of the plurality of tokens of the source document, wherein the one or more attention scores indicates a level of relevance of an associated token to the summary generated by the at least one model;
• aligning each token of the plurality of tokens to at least one word of a plurality of words included in the source document;
• combining, for each word of the plurality of words, attention scores of tokens aligned to the each word to generate an overall attention score for each word of the plurality of words;
• and
• displaying at least one word of the plurality of words with an indication of the overall attention score associated with the at least one word, the indication based on the overall score.