Methods and systems for providing examples to a large language model

A computer system comprising:

• at least one processor;
• and
• a computer readable medium storing instructions that, when executed by the at least one processor, cause the computer system to:
• maintain a conversation history for an ongoing conversation between a client and a large language model (LLM), the conversation history containing one or more previous messages from the client and one or more previous messages from the LLM;
• receive, from the client, a current client message for the ongoing conversation;
• provide an input to the LLM to instruct the LLM to generate an output in response to the current client message, the input to the LLM including at least a portion of the conversation history and including one or more example message pairs inserted into the at least the portion of the conversation history in proximity to the current client message, wherein each example message pair includes a respective example client message and a respective example LLM message;
• and
• output, to the client, an LLM message based on the output generated by the LLM in response to the input;
• wherein the one or more example message pairs are omitted from the maintained conversation history.

A non-transitory computer-readable medium storing instructions that, when executed by at least one processor of a computer system, cause the computer system to:

• maintain a conversation history for an ongoing conversation between a client and a large language model (LLM), the conversation history containing one or more previous messages from the client and one or more previous messages from the LLM;
• receive, from the client, a current client message for the ongoing conversation;
• provide an input to the LLM to instruct the LLM to generate an output in response to the current client message, the input to the LLM including at least a portion of the conversation history and including one or more example message pairs inserted into the at least the portion of the conversation history in proximity to the current client message, wherein each example message pair includes a respective example client message and a respective example LLM message;
• and
• output, to the client, an LLM message based on the output generated by the LLM in response to the input;
• wherein the one or more example message pairs are omitted from the maintained conversation history.