Systems and methods for managing resources in a serverless workload

A computer system for allocating resources to an application comprising a plurality of application components, having at least one executing a function, in a serverless service architecture, the computer system comprising a management system configured to:

• (a) identify a plurality of routing paths, each routing path being associated with a same function executed by one or more containers or serverless execution entities;
• (b) determine traffic information on each routing path and/or at least one of a cost, a response time or a capacity associated with the one or more containers or serverless execution entities on each routing path;
• (c) select one of the plurality of routing paths and its associated one or more containers or serverless execution entities based at least in part on the determination in step (b);
• (d) cause a computational user of the application to access the one or more containers or serverless execution entities on the selected routing path and execute the at least one function thereon;
• (e) update (i) the determined traffic information on each routing path and/or (ii) the determined at least one of the cost, response time or capacity associated with the one or more containers or serverless execution entities on each routing path;
• and
• (f) based at least in part on (i) the updated traffic information and/or (ii) the updated cost, response time and/or capacity associated with the one or more containers or serverless execution entities on each routing path, determine whether to select a second routing path and cause the one or more containers or serverless execution entities associated with the second routing path, different from the selected routing path, to execute a second function, different from the at least one function.

A method of allocating resources to an application comprising a plurality of application components for executing a plurality of functions in a serverless service architecture, the method comprising:

• (a) identifying a plurality of routing paths, each routing path being associated with one or more containers or serverless execution entities;
• (b) determining traffic information on each routing path and/or at least one of a cost, a response time or a capacity associated with the one or more containers or serverless execution entities on each routing path;
• (c) selecting, for each of the functions, one of the plurality of routing paths and its associated one or more containers or serverless execution entities based at least in part on the determination in step (b);
• (d) causing a computational user of the application to access the containers or serverless execution entities corresponding to the selected routing paths for executing the corresponding functions thereon;
• (e) updating (i) the determined traffic information on each routing path and/or (ii) the determined at least one of the cost, response time or capacity associated with the one or more containers or serverless execution entities on each routing path;
• and
• (f) determining, for each of the functions, whether to select a second routing path, different from the corresponding selected routing path, to execute the corresponding function based at least in part on (i) the updated traffic information on each routing path and/or (ii) the updated cost, response time and/or capacity associated with the one or more containers or serverless execution entities on each routing path.

A computer system for allocating resources to an application comprising a plurality of application components for executing a plurality of functions in a serverless service architecture, the computer system comprising a management system configured to:

• (a) identify a plurality of routing paths, each routing path being associated with one or more containers or serverless execution entities;
• (b) determine traffic information on each routing path and/or at least one of a cost, a response time or a capacity associated with the one or more containers or serverless execution entities on each routing path;
• (c) select, for each of the functions, one of the plurality of routing paths and its associated one or more containers or serverless execution entities;
• (d) cause a computational user of the application to access the containers or serverless execution entities corresponding to the selected routing paths for executing the corresponding functions thereon
• (e) update (i) the determined traffic information on each routing path and/or (ii) the determined at least one of the cost, response time or capacity associated with the one or more containers or serverless execution entities on each routing path;
• and
• (f) determine, for each of the functions, whether to select a second routing path, different from the corresponding selected routing path, to execute the corresponding function based at least in part on (i) the updated traffic information on each routing path and/or (ii) the updated cost, response time and/or capacity associated with the one or more containers or serverless execution entities on each routing path.