Back to results
US 2026/0010762 A1Published application
Dynamic intent-based llm arbitration
AssigneeSoundHound AI IP, LLC
InventorKeyvan Mohajer
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for processing prompts to a large language model based on a corresponding intent of a received prompt. The systems and methods select, based on determined corresponding intents, from a plurality of information resource engines to process the received prompts.
Claims20
A system for processing prompts to a large language model (LLM), the system comprising:
- an intent-based processing engine configured to determine a corresponding intent of a received prompt;
- and
- an information resource arbitration engine configured to select, based on the determined corresponding intent, from a plurality of information resource engines to process the received prompt.
A system for processing prompts to a large language model (LLM), the system comprising:
- a memory for storing software code;
- and
- one or more processors configured to execute the software code to:
- receive a prompt;
- provide the prompt to an LLM engine;
- receive from the LLM engine an LLM response to the prompt and a determined confidence level associated with the LLM response;
- compare the determined confidence level to a confidence level threshold;
- and
- select, based on the comparison result, from a plurality of information resource engines to process and provide a response to the prompt.
6 more elements
A method of processing prompts to a large language model (LLM), the method comprising:
- receiving a prompt;
- sending the prompt to an LLM engine to determine a corresponding intent of the prompt;
- receiving the determined intent from the LLM engine;
- selecting based on the determined intent an information resource engine other than the LLM engine that is better able to process the prompt than the LLM engine;
- sending the prompt to the selected information resource engine to process and provide a response to the prompt.
2 more elements
Dependencies are inferred from the claim text.