US 2025/0094814 A1 · FINE-TUNING A LARGE LANGUAGE MODEL (LLM) TO REDUCE THE INSTABILITY OF LLM OUTPUTS TO VARIATIONS IN PROMPTS

Abstract

Techniques are provided for fine-tuning large language models (LLMs) to reduce the instability of LLM outputs to prompt. In one technique, a plurality of prompts is stored. For each prompt of the plurality of prompts, a plurality of variants of that prompt is generated. A prompt generating LLM is fine-tuned based on that prompt and the plurality of variants. Each variant-prompt association (where the variant is generated based on the prompt and has an identical or similar meaning) is a training sample that is used to train or fine-tune the prompt generating LLM. The prompt generating LLM is configured to generate standardized prompts based on input prompts. In another technique, a response generating LLM is fine-tuned based on sets of training samples, each training sample in a set comprising a different variant of a prompt and a response that the response generating LLM generated based on the prompt.

Claims18

Dependent claims

A method comprising:

for each prompt of a plurality of prompts:
generating a plurality of variants of said each prompt;
fine-tuning a first large language model (LLM) based on said each prompt and the plurality of variants,
wherein the first LLM is trained to generate a standardized prompt based on an input prompt;
after fine-tuning the first LLM, receiving a particular prompt;
causing the first LLM to generate a particular standardized prompt based on the particular prompt;
causing a second LLM to generate a response based on the particular standardized prompt;
wherein the method is performed by one or more computing devices.

5 more elements

Dependencies are inferred from the claim text.

Fine-tuning a large language model (llm) to reduce the instability of llm outputs to variations in prompts

Life of this patent

Fine-tuning a large language model (llm) to reduce the instability of llm outputs to variations in prompts

Life of this patent

Abstract

Claims18