Evaluating natural language processing components

A computer-implemented method, comprising:

• receiving first data corresponding to processing of a first user input using a first component, the first data including first output data;
• receiving second data corresponding to processing of the first user input using a first updated component, the second data including second output data different from the first output data;
• determining the second data results in an undesired response;
• and
• determining a second updated component using the first updated component, the determining of the second updated component being based at least in part on processing of the first data with respect to the second data.

A system comprising:

• at least one processor;
• and
• at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
• receive first data corresponding to processing of a first user input using a first component, the first data including first output data;
• receive second data corresponding to processing of the first user input using a first updated component, the second data including second output data different from the first output data;
• determine the second data results in an undesired response;
• and
• determine a second updated component using the first updated component, the determining of the second updated component being based at least in part on processing of the first data with respect to the second data.