Method and system for large language model (llm)-selection for response generation to user queries
AssigneeL&T Technology Services Limited
InventorsRAGHUNANDAN PATTHAR, THEJAS NAGESH, VINAY INJALKAR
Life of this patent
Estimating the term…
Loading patent…
AssigneeL&T Technology Services Limited
InventorsRAGHUNANDAN PATTHAR, THEJAS NAGESH, VINAY INJALKAR
Estimating the term…
Disclosed herein, is a method and system for selecting a LLM for response generation to user queries. The method includes receiving a user query from a user device. The method includes determining, for the user query, a query type from a set of query types through a fine-tuned text classification model. The method includes retrieving a plurality of document embeddings based on the user query and the query type from a vector database through a semantic search technique. The method includes preparing a prompt using the user query and the plurality of document embeddings. The method includes inputting the prompt to an LLM selected from a set of LLMs based on the query type. The method includes generating, via the selected LLM, a response to the user query based on the prompt.
A method of Large Language Model (LLM)-selection for response generation to user queries, the method comprising:
A system for LLM-selection for response generation to user queries, the system comprising:
A non-transitory computer-readable medium storing computer-executable instructions for Large Language Model (LLM)-selection for response generation to user queries:
Dependencies are inferred from the claim text.