Scaling-aware traffic request prioritization for scalable connection-based resource

A method, performed by one or more processors of one or more computing devices, the method comprising:

• receiving, by a first request priority manager, request traffic for a scalable connection-based resource;
• monitoring a connection capacity or request processing capacity of the scalable connection-based resource;
• applying, by the first request priority manager and in response to a determination that the scalable connection-based resource is at or within a threshold limit of a maximum capacity for the connection capacity or request processing capacity of the scalable connection-based resource, a first priority policy obtained from a policy data store to newly received request traffic for the scalable connection-based resource to determine a priority of some of the newly received requests over others;
• and
• in response to determining that the scalable connection-based resource is no longer at or within the threshold limit of the maximum capacity for the scalable connection-based resource, cease applying the first priority policy to newly received request traffic for the scalable connection-based resource.

One or more non-transitory computer-readable media storing program instructions executable on or across one or more processors implement a first request priority manager to:

• monitor a connection capacity or request processing capacity of a scalable connection-based resource to which request traffic is directed;
• begin application, in response to a determination that the scalable connection-based resource is at or within a threshold limit of a maximum capacity for the connection capacity or request processing capacity of the scalable connection-based resource, of a first priority policy obtained from a policy data store to newly received request traffic for the scalable connection-based resource to determine a priority of some of the newly received requests over others;
• and
• cease application, in response to a determination that the scalable connection-based resource is no longer at or within the threshold limit of the maximum capacity for the scalable connection-based resource, of the first priority policy to newly received request traffic for the scalable connection-based resource.