Debugging tool for code generation neural language models

A computer-implemented method, comprising:

• obtaining in a source code editor an output source code snippet generated from a neural language model given an input source code snippet, wherein the output source code snippet includes an output sequence of source code tokens, wherein the input source code snippet includes an input sequence of tokens;
• selecting a select one of the source code tokens of the output source code snippet generated by the neural language model;
• computing a smallest subset of source code tokens of the input source code sequence that led to generation of the selected one of the source code tokens of the output source code snippet by the neural language model;
• and
• identifying in the source code editor, each of the source code tokens of the input source code sequence of the smallest subset.

One or more hardware storage devices having stored thereon computer executable instructions that are structured to be executable by one or more processors of a computing device to thereby cause the computing device to:

• obtain a source code snippet generated by a neural language model given an input sequence of natural language text, wherein the input sequence includes a plurality of input natural language tokens, wherein the source code snippet includes a plurality of source code tokens;
• select a select one of the source code tokens of the output source code snippet generated by the neural language model;
• generate a smallest subset of natural language tokens of the input sequence that led to generation of the selected one of the source code tokens of the output source code snippet by the neural language model;
• and
• identify in a user interface, each of the natural language tokens of the input source code sequence of the smallest subset.