Method and system for scalable performance testing in cloud computing environments

A system, comprising:

• a memory comprising executable instructions;
• and
• a processor configured to execute the executable instructions and cause the system to perform a method comprising:
• receiving a request to test application code, the request including information identifying an amount of load generated by the request in testing the application code;
• calculating one or more minimal sets of resource pod configurations for the request based on the amount of load generated by the request, wherein the one or more minimal sets of resource pod configurations for the request are calculated based on a maximum amount of load that can be generated by each of a plurality of resource pod configurations and the amount of load indicated in the request, wherein the one or more minimal sets of resource pod configurations comprise a minimal set of one or more virtual compute instances (VCIs). the minimal set of one or more VCIs being selected using a resource minimization strategy that selects a lowest cost configuration of VCIs from a plurality of configurations the plurality of configurations including configurations selected from a plurality of VCIs having a plurality of different supported transactions per second, each respective resource pod configuration of the one or more minimal sets of resource pod configurations being associated with a respective pod-level maximum load and including one or more VCIs;
• instantiating a plurality of instances implementing test code for the request using the one or more minimal sets of resource pod configurations;
• executing the test code using the plurality of instances;
• retrieving test results generated by each of the plurality of instances;
• generating a consolidated test result by merging the test results generated by each of the plurality of instances, the consolidated test result including information about a success of executing the test code;
• and
• deploying the application code based on determining that the consolidated test results meet a threshold for the application code.

A non-transitory computer readable medium storing instruction executable by a processor to perform a method for performance testing computing services, the method comprising:

• receiving a request to test application code, the request including information identifying an amount of load generated by the request in testing the application code;
• calculating one or more minimal sets of resource pod configurations for the request based on the amount of load generated by the request, wherein the one or more minimal sets of resource pod configurations for the request are calculated based on a maximum amount of load that can be generated by each of a plurality of resource pod configurations and the amount of load indicated in the request, wherein the one or more minimal sets of resource pod configurations comprise a minimal set of one or more virtual compute instances (VCIs). the minimal set of one or more VCIs being selected using a resource minimization strategy that selects a lowest cost configuration of VCIs from a plurality of configurations, the plurality of configurations including configurations selected from a plurality of VCIs having a plurality of different supported transactions per second, each respective resource pod configuration of the one or more minimal sets of resource pod configurations being associated with a respective pod-level maximum load and including one or more VCIs;
• instantiating a plurality of instances implementing test code for the request using the one or more minimal sets of resource pod configurations;
• executing the test code using the plurality of instances;
• retrieving test results generated by each of the plurality of instances;
• generating a consolidated test result by merging the test results generated by each of the plurality of instances, the consolidated test result including information about a success of executing the test code;
• and
• deploying the application code based on determining that the consolidated test results meet a threshold for the application code.