Plan bank for api chains in routing engine for generative model-based digital assistant

A system comprising:

• one or more processors;
• and
• one or more computer-readable media storing instructions which, when executed by the one or more processors, cause the system to perform operations comprising:
• receiving an utterance from a user in an inference mode associated with an agent;
• accessing, based on the utterance, a plan bank that comprises a plurality of tools comprising one or more composite tools, wherein each of the one or more composite tools comprises:
• (i) a chain of tools including:
• a plurality of application programming interface (API) tools, a plurality of other composite tools, or any combination thereof, and (ii) associated logic;
• generating, by a first generative artificial intelligence model based on the plan bank and the utterance, an action plan comprising a composite tool of the one or more composite tools;
• executing the action plan to obtain response data, wherein executing the action plan comprises executing one or more actions associated with each of the plurality of API tools, the plurality of other composite tools, or any combination thereof associated with the composite tool based on the associated logic to obtain the response data;
• generating, by a second generative artificial intelligence model, a response to the utterance based on the response data;
• and
• providing the response to the user.

One or more non-transitory computer-readable media storing instructions which, when executed by one or more processors, cause a system to perform operations comprising:

• receiving an utterance from a user in an inference mode associated with an agent;
• accessing, based on the utterance, a plan bank that comprises a plurality of tools comprising one or more composite tools, wherein each of the one or more composite tools comprises:
• (i) a chain of tools including:
• a plurality of application programming interface (API) tools, a plurality of other composite tools, or any combination thereof, and (ii) associated logic;
• generating, by a first generative artificial intelligence model based on the plan bank and the utterance, an action plan comprising a composite tool of the one or more composite tools;
• executing the action plan to obtain response data, wherein executing the action plan comprises executing one or more actions associated with each of the plurality of API tools, the plurality of other composite tools, or any combination thereof associated with the composite tool based on the associated logic to obtain the response data;
• generating, by a second generative artificial intelligence model, a response to the utterance based on the response data;
• and
• providing the response to the user.