Dynamically computing load balancer subset size in a distributed computing system

A computer-implemented method for dynamically subsetting a plurality of load balancers in a distributed computer system, the method comprising:

• receiving, at each load balancer of the plurality of load balancers in the distributed computer system, one or more requests for connections to one or more back-end servers;
• computing, by each load balancer of the plurality of load balancers in the distributed computer system, a number of requests received at the load balancer;
• sending, from each load balancer of the plurality of load balancers in the distributed computer system to one or more traffic aggregators, a request report including the computed number of requests received at that load balancer;
• receiving, at each load balancer of the plurality of load balancers in the distributed computer system, from a traffic controller, aggregated request data for the plurality of load balancers in the distributed computer system, the aggregated request data comprising a total number of requests received by the plurality of load balancers in the distributed computer system;
• and
• computing, by each load balancer of the plurality of load balancers in the distributed computer system, a subset size for the load balancer based on a percentage of the aggregated request data associated with the load balancer.

A system comprising:

• a processor for executing computer program instructions;
• and
• a non-transitory computer-readable storage medium storing computer program instructions executable by the processor to perform operations for dynamically subsetting a plurality of load balancers in a distributed computer system, the operations comprising:
• receiving, at each of one or more traffic aggregators from each of a plurality of load balancers in a zone corresponding to that traffic aggregator, a request report including a number of requests received by that load balancer;
• sending, from each of the one or more traffic aggregators to a traffic controller, aggregated request data for the corresponding zone, the aggregated request data comprising a total number of requests received by the load balancers in the zone;
• computing, by the traffic controller based on the aggregated request data for each zone, a total number of requests received by all of the load balancers in the distributed computer system;
• and
• sending, from the traffic controller to each of the plurality of load balancers in the distributed computer system, data corresponding to the total number of requests received by all of the load balancers in the distributed computer system, wherein each load balancer of the plurality of load balancers in the distributed computer system computes a subset size based, at least in part, on a percentage of the total number of requests that are received at the load balancer.