Parallelizing api calls in an agentic chatbot workflow

A non-transitory computer-readable medium storing computer-executable instructions that, when executed, cause a computing system to perform operations comprising:

• accessing, by an online system, an agentic workflow, the agentic workflow comprising a set of nodes, the set of nodes comprising a plurality of prompt nodes and a plurality of agentic nodes, wherein each prompt node comprises computer-executable instructions for prompting a large language model to generate an output for the agentic workflow, wherein each agentic node comprises computer-executable instructions for interfacing with a computing system;
• executing computing-executable instructions of a current node of the agentic workflow;
• in parallel with execution of the current node of the agentic workflow:
• identifying a set of candidate agentic nodes in the agentic workflow by identifying a set of agentic nodes that descend from the current node within the agentic workflow;
• identifying, for each candidate agentic node, whether one or more preconditions of the respective candidate agentic node are met, the one or more preconditions representing requirements for the respective candidate agentic node to be executed;
• in response to the one or more preconditions of the respective candidate node being met, executing the respective candidate agentic node by executing the computer-executable instructions of the candidate agentic node.