Systems and methods for rate-based load balancing

A system, comprising:

• a processor;
• and
• a memory storing instructions, which when executed by the processor, cause the processor to:
• select a server, from a plurality of servers, as a potential target;
• receive a readiness indicator for the selected server, wherein the readiness indicator is based on a timing technique using a fixed-capacity token bucket and a classification algorithm to determine if the selected server is to be designated as a target server;
• and
• designate the selected server as the target server based on the readiness indicator;
• and
• transmit a request to the target server for processing.

A method, comprising:

• selecting a server, from a plurality of servers, as a potential target;
• receiving a readiness indicator for the selected server, wherein the readiness indicator is based on a timing technique using a fixed-capacity token bucket and a classification algorithm to determine if the selected server is to be designated as a target server;
• and
• designating the selected server as the target server based on the readiness indicator;
• and
• transmitting a request to the target server for processing.

A non-transitory computer-readable storage medium having an executable stored thereon, which when executed instructs a processor to:

• selecting a server, from a plurality of servers, as a potential target;
• receiving a readiness indicator for the selected server, wherein the readiness indicator is based on a timing technique using a fixed-capacity token bucket and a classification algorithm to determine if the selected server is to be designated as a target server;
• and
• designating the selected server as the target server based on the readiness indicator;
• and
• transmitting a request to the target server for processing.