US 2026/0093692 A1 · FOUNDATION MODEL-ASSISTED MULTI-API INTERFACE FOR USER QUERY FULFILLMENT

Abstract

An application programming interface (API) query interface provides an interface between users and products/services having their own respective API by creating API calls based on user queries. The query interface determines which API and corresponding function to call to fulfill a user query based on determined similarities between embeddings of example queries that have been generated across available API functions and an embedding of the user query. The query interface populates the API function with a value(s) of its parameter(s) determined based on the user query, a specification of the API function including accepted parameters, and examples of user queries and corresponding values of the parameters previously determined for the API function. The agent calls the API function populated with its parameter value(s) to obtain an API response and generates a response to the user query based partly on a size of the API response.

Claims20

Dependent claims

A computer-implemented method comprising:

obtaining a first query comprising natural language;
determining a first application programming interface (API) call of a plurality of API calls to which the first query corresponds based at least partly on comparing an embedding of the first query and a plurality of embeddings generated from first example queries corresponding to the plurality of API calls;
populating the first API call based on determining one or more parameter values of the first API call from the first query, wherein determining the one or more parameter values comprises prompting a first language model to determine the one or more parameter values from the first query based on second example queries and corresponding parameters of the first API call that were previously determined;
issuing the first API call to obtain a response to the first API call;
and
responding to the first query based on the response to the first API call.

3 more elements

One or more non-transitory machine-readable media having program code stored thereon, the program code comprising instructions to:

based on obtaining a first query comprising natural language, determine a first application programming interface (API) function of a plurality of API functions to which the first query corresponds,
wherein the instructions to determine the first API function comprise instructions to compare an embedding of the first query to a plurality of embeddings generated from first example queries and select the first API function based at least partly on a result of the comparison, wherein each of the first example queries corresponds to one of the plurality of API functions;
determine a value of a first parameter of the first API function from the first query based on prompting a first foundation model with a task instruction to extract a value of a parameter of the first API function from the first query;
populate the first API function with the value of the first parameter;
invoke the first API function to obtain an API response;
and
respond to the first query based on the API response.

4 more elements

An apparatus comprising:

a processor;
and
a machine-readable medium having instructions stored thereon that are executable by the processor to cause the apparatus to,
compare an embedding of a user query comprising natural language to a plurality of embeddings generated from first example queries, wherein each of the first example queries corresponds to one of a plurality of application programming interface (API) calls;
based at least partly on results of the comparison, select a first API call of the plurality of API calls as corresponding to the user query;
determine one or more parameter values of the first API call from the user query based on submission of a prompt to a first language model, wherein the prompt comprises a task instruction to determine the one or more parameter values from the user query based on second example queries and corresponding parameter values of the first API call that were previously determined from the second example queries;
populate the first API call with the one or more parameter values;
issue the first API call to obtain a response to the first API call;
and
respond to the user query based on the response to the first API call.

7 more elements

Dependencies are inferred from the claim text.

Foundation model-assisted multi-api interface for user query fulfillment

Life of this patent

Foundation model-assisted multi-api interface for user query fulfillment

Life of this patent

Abstract

Claims20