Systems and methods for choosing an appropriate scaling technique for allocating computational resources to distributed applications

A system comprising:

• one or more processors;
• and
• a memory having stored thereon computer program code that, when executed by the one or more processors, is configured to cause the one or more processors to:
• initiate a first plurality of virtual machine instances configured to execute a first distributed application;
• receive usage metrics associated with the first plurality of virtual machine instances executing the first distributed application;
• create one or more additional virtual machine instances responsive to the usage metrics indicating a resource usage of the first plurality of virtual machine instances exceeding a maximum usage allocation;
• terminate at least one virtual machine instance responsive to the usage metrics indicating the resource usage of the first plurality of virtual machine instances falling below a minimum usage allocation;
• determine a warmup time associated with initializing the one or more additional virtual machine instances by aggregating an initialization time, a deployment time, and a verification time, wherein the initialization time comprises a first amount of time to initialize the one or more additional virtual machine instances, the deployment time comprises a second amount of time necessary to deploy the first distributed application on the one or more additional virtual machine instances, and the verification time comprises a third amount of time necessary to verify that the first distributed application has been successfully deployed on the one or more additional virtual machine instances;
• and
• pre-allocate the one or more additional virtual machine instances for executing the first distributed application when the warmup time exceeds a predetermined threshold.

A system comprising:

• one or more processors;
• and
• a memory having stored thereon computer program code that, when executed by the one or more processors, is configured to cause the one or more processors to:
• receive usage metrics associated with the a plurality of distributed applications executed on a plurality of virtual machine instances;
• for each distributed application, determine a number of downstream applications associated with a respective distributed application;
• for each distributed application, determine that the respective distributed application comprises a cyclic usage pattern, a batch usage pattern, or a non-cyclic usage pattern;
• for each distributed application, create one or more additional virtual machine instances responsive to the number of downstream applications exceeding a predetermined threshold, wherein the one or more additional virtual machine instances are configured for use during a future period of time when an allocation of computational resources to each distributed application exceeds a threshold within a first period of time;
• determine a warmup time associated with initializing the one or more additional virtual machine instances by aggregating an initialization time, a deployment time, and a verification time, wherein the initialization time comprises a first amount of time to initialize the one or more additional virtual machine instances, the deployment time comprises a second amount of time necessary to deploy the plurality of distributed applications on the one or more additional virtual machine instances, and the verification time comprises a third amount of time necessary to verify that the plurality of distributed applications has been successfully deployed on the one or more additional virtual machine instances;
• and
• pre-allocate the one or more additional virtual machine instances for executing the plurality of distributed applications when the warmup time exceeds a predetermined threshold.