US 12,701,603 B1Granted

Updating a request during propagation among services to include different priority values for request processing

AssigneeAmazon Technologies, Inc.

InventorsJui Te Tseng, Eva Lacy, Avinash Nagasundaram, Forrest MacKenzie Vines, Issa Rashid Fattah

Life of this patent

Estimating the term…

Loading patent…

Abstract

Various techniques are described for updating a request during propagation among services to include different priority values. Each service may determine its own priority for a request and add that priority to the request's overall priority value before propagating the request to the next service. When an overloaded service receives multiple requests, it may order the requests into a queue based on the different priority values. This may allow multiple different services to affect the priority/importance of any given request. A service may use the different priorities in order to determine the lowest priority requests that should be dropped when a queue needs to make room for a higher priority request.

Claims20

Dependent claims

A system, comprising:

one or more processors;
and
one or more memories, wherein the one or more memories have stored thereon instructions, which when executed by the one or more processors, cause the one or more processors to implement:
a service of a provider network, wherein the service is configured to:
receive a request from a client;
determine, based on one or more attributes associated with the request, a first priority value for the request, wherein the first priority value indicates a priority of the request relative to other requests received by the service;
update the request to include the first priority value to generate a first updated request;
and
propagate the first updated request to another service of the provider network;
and
the other service of the provider network, wherein the other service is configured to:
receive the first updated request from the service;
determine, based on one or more of attributes associated with the first updated request, a second priority value for the first updated request, wherein the second priority value indicates a priority of the first updated request relative to other requests received by the other service;
update the first updated request, which was received from the service by the other service, to include the second priority value determined by the other service, to generate a second updated request that comprises the first priority value assigned by the service and the second priority value assigned by the other service after the first priority value was assigned by the service;
and
propagate the second updated request to an additional service of the provider network.

13 more elements

A method, comprising:

performing, by one or more computing devices of a provider network:
receiving a request for a service from another service, wherein the request comprises a priority value, and wherein the priority value comprises a first priority value that indicates a priority of the request relative to other requests received by the other service;
determining, based on one or more attributes associated with the request, a second priority value for the request, wherein the second priority value indicates a priority of the request relative to other requests received by the service;
updating the request, which was received from the other service by the service, to include the second priority value determined by the service, to generate a first updated request that comprises the first priority value assigned by the other service and the second priority value assigned by the service after the first priority value was assigned by the other service;
and
propagating the first updated request from the service to an additional service.

3 more elements

One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors cause the one or more processors to implement a service to:

receive a request from another service, wherein the request comprises a priority value, and wherein the priority value comprises a first priority value that indicates a priority of the request relative to other requests received by the other service;
determine, based on one or more attributes associated with the request, a second priority value for the request, wherein the second priority value indicates a priority of the request relative to other requests received by the service;
update the request, which was received from the other service by the service, to include the second priority value determined by the service, to generate a first updated request that comprises the first priority value assigned by the other service and the second priority value assigned by the service after the first priority value was assigned by the other service;
and
propagate the first updated request to an additional service.

2 more elements

Dependencies are inferred from the claim text.