System and method for routing service requests

A system comprising:

• a data store configured to store information about a plurality of candidate host zones, wherein each candidate host zone comprises a plurality of service hosts for servicing service requests;
• and
• a first candidate host in communication with the data store, the first candidate host configured to:
• obtain a service request;
• determine a service latency of the first candidate host;
• determine a service latency associated with each of the plurality of candidate host zones, wherein the service latency associated with each of the plurality of candidate host zones is based at least in part on one or more service latencies associated with the plurality of service hosts belonging to the respective candidate host zone;
• determine whether to service the service request or route the service request to one or more candidate host zones of the plurality of candidate host zones, wherein the determination is based at least in part on the service latency of the first candidate host and the service latency associated with each of the one or more candidate host zones;
• and
• in response to determining whether to service the service request or route the service request to the one or more candidate host zones, service the service request or route the service request to the one or more candidate host zones.

A non-transitory computer-readable medium having stored thereon a computer executable module configured to execute in one or more processors of a first candidate host, the computer-executable module being further configured to:

• obtain a service request;
• determine a service latency of the first candidate host;
• discover a plurality of candidate host zones for servicing the service request, wherein each candidate host zone of the plurality of candidate host zones comprises a plurality of service hosts for servicing the service request;
• determine a service latency for each of the plurality of candidate host zones, wherein the service latency for each of the plurality of candidate host zones is based at least in part on one or more service latencies associated with the plurality of service hosts comprising the respective candidate host zone;
• determine whether to service the service request or route the service request to one or more candidate host zones of the plurality of candidate host zones based at least in part on the service latency of the first candidate host and the service latency for each of the one or more candidate host zones;
• and
• in response to determining whether to service the service request or route the service request the one or more candidate host zones, service the service request or route the service request to the one or more candidate host zones.