System and method for routing service requests
AssigneeAmazon Technologies, Inc.
InventorsDan Mihai Dumitriu, Swaminathan Sivasubramanian
Life of this patent
Estimating the term…
Abstract
A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
Claims14
A computer-implemented method comprising:
- receiving a service request;
- determining which of a plurality of candidate host computing devices to use for servicing the service request by at least:
- for particular candidate host computing devices of the plurality of candidate host computing devices, assigning a weighting to the particular candidate host computing device based in part on latency information representing a service latency reflecting a queuing latency and a time required to process the service request by the particular candidate host computing device;
- and
- selecting a candidate host computing device from the particular candidate host computing devices for servicing the service request based, at least in part, on the respective weighting assigned to each of the particular candidate host computing devices;
- and
- routing the service request to the selected candidate host computing device.
A system comprising:
- a plurality of candidate host computing devices;
- wherein the system is configured to:
- receive a service request;
- determine which of a plurality of candidate host computing devices to use for servicing the service request by at least:
- for particular candidate host computing devices of the plurality of candidate host computing devices, assigning a weighting to the particular candidate host computing device based in part on latency information representing a service latency reflecting a queuing latency and a time required to process the service request by the particular candidate host computing device;
- and
- selecting a candidate host computing device from the particular candidate host computing devices for servicing the service request based, at least in part, on the respective weighting assigned to each of the particular candidate host computing devices;
- and
- route the service request to the selected candidate host computing device.
A non-transitory computer-readable medium bearing computer-executable instructions which, when executed on a computing device, direct the computing device to:
- receive a service request;
- determine which of a plurality of candidate host computing devices to use for servicing the service request by at least:
- for particular candidate host computing devices of the plurality of candidate host computing devices, assigning a weighting to the particular candidate host computing device based in part on latency information representing a service latency reflecting a queuing latency and a time required to process the service request by the particular candidate host computing device;
- and
- selecting a candidate host computing device from the particular candidate host computing devices for servicing the service request based, at least in part, on the respective weighting assigned to each of the particular candidate host computing devices;
- and
- route the service request to the selected candidate host computing device.
Dependencies are inferred from the claim text.