Saving production runs of a function as unit test and automatic output regeneration

A system for managing one or more models, the system comprising:

• one or more processors;
• and
• a memory that stores computer-executable instructions, wherein the computer-executable instructions, when executed, cause the one or more processors to:
• receive, via a user interface, from a user a first user input for a large language model (“LLM”);
• generate, based on the first user input, a first prompt;
• transmit the first prompt to the LLM;
• receive an output from the LLM;
• evaluate the output from the LLM with reference to one or more validation tests;
• responsive to determining that the output from the LLM is not validated, generate a second prompt for the LLM, wherein the second prompt indicates at least an aspect of the output that caused the output to not be validated;
• transmit the second prompt to the LLM;
• and
• receive an updated output from the LLM.

One or more non-transitory computer-readable media comprising computer-executable instructions for managing one or more models, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to perform operations comprising:

• receiving, via a user interface, from a user a first user input for a large language model (“LLM”);
• generating, based on the first user input, a first prompt;
• transmitting the first prompt to the LLM;
• receiving an output from the LLM;
• evaluating the output from the LLM with reference to one or more validation tests;
• responsive to determining that the output from the LLM is not validated, generating a second prompt for the LLM, wherein the second prompt indicates at least an aspect of the output that caused the output to not be validated;
• transmitting the second prompt to the LLM;
• and
• receiving an updated output from the LLM.