Techniques for dynamic rate-limiting

A computer-implemented method for asynchronous rate-limiting at a rate-limit decision node, the computer-implemented method comprising:

• receiving a rate-limiting request for a service application;
• extracting one or more policy-defining parameters from the rate-limiting request;
• querying a local cache storage medium associated with the rate-limit decision node to identify one or more local rate-limiting policies associated with the rate-limiting request, wherein the local cache storage medium is configured to receive one or more asynchronous configuration data updates from a rate-limit synchronization server, and further wherein the rate-limit decision node is configured to update the one or more local rate-limiting policies based on the one or more asynchronous configuration data updates;
• determining, based on the one or more policy-defining parameters and the one or more local rate-limiting policies, a rate-limiting decision for the rate-limiting request;
• and
• transmitting the rate-limiting decision to the service application in response to the rate-limiting request.

A computer program product for asynchronous rate-limiting at a rate-limit decision node, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions configured to:

• receive a rate-limiting request for a service application;
• extract one or more policy-defining parameters from the rate-limiting request;
• query a local cache storage medium associated with the rate-limit decision node to identify one or more local rate-limiting policies associated with the rate-limiting request, wherein the local cache storage medium is configured to receive one or more asynchronous configuration data updates from a rate-limit synchronization server, and further wherein the rate-limit decision node is configured to update the one or more local rate-limiting policies based on the one or more asynchronous configuration data updates;
• determine, based on the one or more policy-defining parameters and the one or more local rate-limiting policies, a rate-limiting decision for the rate-limiting request;
• and
• transmit the rate-limiting decision to the service application in response to the rate-limiting request.