Accelerated throttling for web servers and services

A server to provide accelerated throttling for web servers and services, the server comprising:

• a communication interface configured to facilitate communication between the server, and one or more computing devices;
• a memory configured to store instructions;
• and
• one or more processors coupled to the communication interface and the memory and configured to execute a management application for the server, wherein the one or more processors are configured to:
• collect request data for requests submitted to the server at the datacenter;
• determine a request metric and a window based on the collected request data, wherein the request metric defines a limit for a number of requests from a source to be accepted within the window;
• monitor incoming requests for the server at the datacenter;
• identify a subset of requests from the source;
• count the subset of the requests associated with the identified source;
• and
• in response to determining that a number of requests from the source exceed the determined request metric within the window, deny further requests from the source until the window expires.

A datacenter to provide accelerated throttling for web servers and services, the datacenter comprising:

• a common cache shared among a plurality of servers of the datacenter;
• and
• the plurality of servers configured to execute one or more hosted services or applications, each of the plurality of servers comprising:
• a communication interface configured to facilitate communication between the plurality of servers, and one or more computing devices submitting requests to the plurality of servers;
• a memory configured to store instructions;
• and
• one or more processors coupled to the communication interface and the memory and configured to execute a management application for a respective server, wherein the one or more processors are configured to:
• determine a request metric and a window based on historic usage information, wherein the request metric defines a limit for a number of requests from a source to be accepted within the window;
• monitor incoming requests by creating or updating a record at a local cache of the respective server and at a common cache of the plurality of servers for every incoming request, the record comprising a counter for the request, a source identifier, and a window identifier,
• query the common cache for a maximum value hit of the record;
• and
• in response to determining the maximum value hit, deny further requests from the source until the window expires.