Dynamic prompt template enforcement and categorization system

A method, comprising:

• identifying, by a computing device, a prompt that has been submitted by a client device for a large language model (LLM) service;
• determining, by the computing device, that the prompt fails to match an existing prompt template;
• determining, by the computing device, that the prompt and an unidentified prompt meet a similarity threshold based at least in part on a common prompt component shared between the prompt and the unidentified prompt;
• and
• generating, by the computing device, a prompt template for the LLM service based at least in part on the prompt and the unidentified prompt meeting the similarity threshold, the prompt template comprising the common prompt component and a placeholder.

A non-transitory, computer-readable medium, comprising machine-readable instructions that, when executed by a processor of a computing device, cause the computing device to at least:

• identify a prompt that has been submitted by a client device for a large language model (LLM) service;
• determine that the prompt fails to match an existing prompt template;
• determine that the prompt and an unidentified prompt meet a similarity threshold based at least in part on a common prompt component shared between the prompt and the unidentified prompt;
• and
• generate a prompt template for the LLM service based at least in part on the prompt and the unidentified prompt meeting the similarity threshold, the prompt template comprising the common prompt component and a placeholder.