System and method for routing service requests
AssigneeAmazon Technologies, Inc.
InventorsDan Mihai Dumitriu, Swaminathan Sivasubramanian
Life of this patent
Estimating the term…
Abstract
A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
Claims1
A computer-implemented method of operating a first candidate host, the computer-implemented method comprising:
- obtaining a service request;
- determining a service latency of the first candidate host;
- discovering a plurality of candidate host zones for servicing the service request, wherein each candidate host zone of the plurality of candidate host zones comprises a plurality of service hosts for servicing the service request;
- determining a service latency for each of the plurality of candidate host zones, wherein the service latency for each of the plurality of candidate host zones is based at least in part on one or more service latencies associated with the plurality of service hosts comprising the respective candidate host zone;
- determining whether to service the service request or route the service request to one or more candidate host zones of the plurality of candidate host zones based at least in part on a probabilistic distribution representing the service latency of the first candidate host and the service latency for each of the one or more candidate host zones;
- and
- in response to determining whether to service the service request or route the service request to the one or more candidate host zones, servicing the service request or routing the service request to the one or more candidate host zones.
Dependencies are inferred from the claim text.