Real-time, multi-tier load test results aggregation

A non-transitory computer-readable storage medium encoded with a computer program product, which, when executed, is operable to:

• (a) compute first-level aggregated test results within each of a plurality of load server instances during execution of a load test that generates a load on a target website, the load including requests of a plurality of virtual users, the first-level aggregated test results including first-level response time statistics computed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances every first time interval, the statistics including an average response time across a subset of the plurality of virtual users;
• (b) send the first-level aggregated test results from each of the plurality of load server instances to an associated one of a plurality of analytic server instances every second time interval, the second time interval being longer than the first time interval;
• (c) compute second-level aggregated test results by each of the plurality of analytic server Instances in response to receiving the first-level aggregated test results from the plurality of load server instances every second time interval, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results;
• (d) store the second-level aggregated test results in a data storage instance;
• (e) run a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users;
• and
• (f) communicate the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic,
• wherein (a)-(f) are each performed in real-time during the running of the load test.

A computer-implemented method for real-time analysis of results from a load test as the load test is being performed on a target website, comprising:

• computing first-level aggregated test results within each of a plurality of load server instances, each load server instance simulating a plurality of virtual users that generate a load on the target website, the first-level aggregated test results including statistics computed by an embedded component within each of the plurality of load server instances as the load test is being performed from data received by each of the plurality of load server instances from the target website in response to the generated load, the first-level aggregated test results being computed every N seconds, where N is a positive integer, the statistics including an average response time across a subset of the plurality of virtual users;
• sending, as the load test is being performed, a batch message that includes all of the first-level aggregated test results computed by each of the plurality of load server instances to an associated one of a plurality of analytic server instances every M seconds, where M is an integer greater than N;
• computing, as the load test is being performed, second-level aggregated test results by each of the plurality of analytic server instances in response to receiving the first-level aggregated test results from the plurality of load server instances every M seconds, the second-level aggregated test results including second-level response time statistics computed from the first-level aggregated test results;
• storing, as the load test is being performed, the second-level aggregated test results in a data storage instance;
• running, as the load test is being performed, a query to the data storage instance to perform one or more statistical functions on the second-level aggregated test results, thereby producing third-level aggregated test results, the third-level aggregated test results including a website response time statistic across all of the virtual users;
• and
• communicating, as the load test is being performed, the third-level aggregated test results to a browser application for providing an analytic dashboard with a graphical user interface that outputs the website response time statistic in real-time.