Back to results
US 2026/0064670 A1Published application
Natural language endpoint manipulation with a large language model
OwnerBin Wang, Sayali Pradip Kamatinventors
Life of this patent
Estimating the term…
Abstract
A user query that includes a natural language description for access to a backend service of a plurality of backend services is received from a client device. The user query is routed to the backend service based in part on an large language model understanding of the natural language description. A response is received from the backend service. The response is provided to the client device.
Claims20
A method, comprising:
- receiving at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
- routing the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the backend service, and wherein based on the prompt, the second large language model generates an application program interface (API) request to obtain a response to the user query and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
- receiving a response from the backend service;
- and
- providing the response to the client device.
2 more elements
(canceled)
(canceled)
(canceled)
A system, comprising:
- a processor configured to:
- receive at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
- route the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the routing service, and wherein based on the prompt, the second large language model generates an application program interface (API) request and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
- receive a response from the backend service;
- and
- provide the response to the client device;
- and
- a memory coupled to the processor and configured to provide the processor with instructions.
5 more elements
A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
- receiving at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
- routing the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the backend service, and wherein based on the prompt, the second large language model generates an application program interface (API) request to obtain a response to the user query and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
- receiving a response from the backend service;
- and
- providing the response to the client device.
2 more elements
Dependencies are inferred from the claim text.