Large language model response optimization using custom computer languages

A computer-implemented method comprising:

• receiving, via a user interface, a natural language query;
• receiving an indication of a format of a custom computer language and an indication of one or more computer-based tools stored in and/or accessible by a computer system;
• transmitting a prompt to a large language model (“LLM”), the prompt comprising at least:
• at least a portion of the natural language query, the indication of the format of the custom computer language, and the indication of the one or more computer-based tools, wherein an argument is described in natural language in the custom computer language, wherein the indication of the format of the custom computer language comprises an example grammatical structure in the custom computer language, and wherein the one or more computer-based tools use a second computer language having a second format different from the format;
• receiving, from the LLM, a response to the prompt, wherein the response is in the format of the custom computer language, wherein the format of the custom computer language provided in the prompt causes the LLM to generate the response in a first tokenized representation that has a higher token density than a second tokenized representation based on the second format of the second computer language;
• parsing the response in the custom computer language to identify at least:
• a computer-based tool of the one or more computer-based tools, a type of an element in the response, and a first query to be provided to the computer-based tool;
• generating, based on the parsing of the response and the identified first query, a second query in the second computer language different from the custom computer language;
• and
• providing the second query in the second computer language to the computer-based tool.

A system for updating a format of a target computer language, the system comprising:

• one or more computer-readable storage mediums having program instructions embodied therewith;
• and
• one or more processors configured to execute the program instructions to cause the system to:
• receive, via a user interface, a natural language query;
• receive an indication of a format of a custom computer language, wherein an argument is described in natural language in the custom computer language, wherein the indication of the format of the custom computer language comprises an example grammatical structure in the custom computer language;
• transmit a prompt to a large language model (“LLM”), the prompt comprising at least:
• at least a portion of the natural language query and the indication of the format;
• receive, from the LLM, a first response to the prompt in the format of the custom computer language;
• determine and/or receive an indication of a mistake in the first response to the prompt;
• and
• automatically update, based on the mistake, the format of the custom computer language to generate an updated format, wherein the updated format is configured to reduce a likelihood of the LLM generating a second response with the same mistake thereby improving accuracy of the LLM processing the custom computer language in the updated format.