System and methods for optimized execution plans for serverless directed acyclic graph workflows

A system, comprising:

• a processor, the processor configured to:
• receive a first directed acyclic graphic (DAG) for an application, the DAG comprising a plurality of stages arranged in a series, each stage comprising at least one function;
• model performance of each function in the DAG to generate a performance model;
• generate a plurality of variant DAGs, wherein functions in the variant DAGs from at least two consecutive stages in the first DAG are vertically combined;
• for each of the variant DAGs,
• obtain a configuration vector, comprising a plurality of combinations of bundle size and computer resource allocations;
• and
• forecast, based on the performance model and the configuration vector, a plurality of end-to-end latency distributions for the variant DAGS;
• select the variant DAG and configuration vector based on a selection criteria;
• and
• cause an application to be executed according to the variant DAG and configuration vector.