Back to results
US 2025/0165752 A1Published application
Systems and methods for processing data for large language models
AssigneeInfobip Ltd.
InventorIvica LOVRIC
Life of this patent
Estimating the term…
Abstract
A method includes: receiving a query; determining a capability associated with the query using at least one of a capability machine learning model or a segmentation algorithm; determining, using a routing system, a large language model provider, among a plurality of large language model providers, that best matches the capability associated with the query; providing the query to the large language model provider; and receiving a response from the large language model provider.
Claims20
A method comprising:
- receiving a query;
- determining a capability associated with the query using at least one of a capability machine learning model or a segmentation algorithm;
- determining, using a routing system, a large language model provider, among a plurality of large language model providers, that best matches the capability associated with the query;
- providing the query to the large language model provider;
- and
- receiving a response from the large language model provider.
3 more elements
A method comprising:
- receiving a query;
- determining that the query matches a cached query;
- retrieving a cached response from a large language model provider for the cached query;
- and
- providing the cached response.
2 more elements
A system comprising one or more processors configured to execute a method including:
- receiving a query;
- determining a capability associated with the query using at least one of a capability machine learning model or a segmentation algorithm;
- determining, using a routing system, a large language model provider, among a plurality of large language model providers, that best matches the capability associated with the query;
- providing the query to the large language model provider;
- and
- receiving a response from the large language model provider.
3 more elements
Dependencies are inferred from the claim text.