Language model tool calling and execution platform
AssigneeArcade Ai, Inc.
InventorsSAMUEL HOLT PARTEE, Nathanael Robert BARBETTINI, Sterling Patrick DREYER, Alexander SALAZAR
Life of this patent
Estimating the term…
Abstract
A system for processing client requests in an AI ecosystem is provided. The system may receive a client request from a client application, where the client request is based upon a user request. The system may provide a model request, based upon the client request, to a first model (e.g., an LLM), receive, from the first model, a structured response based upon the model request, and cause execution of tool functions based upon the structured response.
Claims31
1-59. (canceled)
A system for authorizing requests, the system comprising:
- a. one or more memories storing instructions;
- and
- b. one or more processors, operably coupled to the one or more memories, for executing the instructions that cause the system to:
- i. provide a model request, based upon a client request, to a first model of one or more models, wherein the client request is based upon a user request from a user;
- ii. receive, from the first model, a structured response specifying one or more tool functions based upon the model request;
- and
- 1. for at least one tool function of the one or more tool functions:
- a. if authorization is required for execution of the tool function by a corresponding service provider of one or more service providers:
- i. provide, to a client application, information to enable access to the corresponding service provider;
- and
- ii. receive an indication of access permission for access to the corresponding service provider,
- iii. wherein the access permission indication enables execution of the tool function.
A method comprising:
- a. providing a model request, based upon a client request, to a first model of one or more models, wherein the client request is based upon a user request from a user;
- b. receiving, from the first model, a structured response specifying one or more tool functions based upon the model request;
- and
- i. for at least one tool function of the one or more tool functions:
- 1. if authorization is required for execution of the tool function by a corresponding service provider of one or more service providers:
- a. providing, to a client application, information to enable access to the corresponding service provider;
- and
- b. receiving an indication of access permission for access to the corresponding service provider,
- c. wherein the access permission indication enables execution of the tool function.
One of more non-transitory computer readable media comprising instructions that, when executed by at least one processor, cause a computer system to:
- a. provide a model request, based upon a client request, to a first model of one or more models, wherein the client request is based upon a user request from a user;
- b. receive, from the first model, a structured response specifying one or more tool functions based upon the model request;
- and
- i. for at least one tool function of the one or more tool functions:
- 1. if authorization is required for execution of the tool function by a corresponding service provider of one or more service providers:
- a. provide, to a client application, information to enable access to the corresponding service provider;
- and
- b. receive an indication of access permission for access to the corresponding service provider,
- c. wherein the access permission indication enables execution of the tool function.
Dependencies are inferred from the claim text.