Multi-tenant rate limiting service for distributed systems

A system comprising:

• one or more processors;
• and
• at least one memory, the one or more processors and the at least one memory configured to:
• receive, by a global rate limiter, one or more global rate limits, each global rate limit of the one or more global rate limits associated with a corresponding tag and a corresponding microservice of a plurality of microservices in a request execution chain of a distributed system, each global rate limit of the one or more global rate limits indicating a rate of requests tagged with the corresponding tag associated with the global rate limit allowed to be processed by the corresponding microservice associated with the global rate limit;
• and
• configure, by the global rate limiter, for each global rate limit of the one or more global rate limits:
• each of one or more local rate limiters associated with one or more instances of the corresponding microservice associated with the global rate limit with a local rate limit indicating a rate of requests tagged with the corresponding tag associated with the global rate limit allowed to be processed by the instance of the corresponding microservice associated with the global rate limit, wherein the local rate limit of each of the one or more local rate limiters is based on the global rate limit.

A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations for configuring rate limiting policies for a plurality of microservices in a request execution chain of a distributed system, the operations comprising:

• receiving, by a global rate limiter, one or more global rate limits, each global rate limit of the one or more global rate limits associated with a corresponding tag and a corresponding microservice of the plurality of microservices, each global rate limit of the one or more global rate limits indicating a rate of requests tagged with the corresponding tag associated with the global rate limit allowed to be processed by the corresponding microservice associated with the global rate limit;
• and
• configuring, by the global rate limiter, for each global rate limit of the one or more global rate limits:
• each of one or more local rate limiters associated with one or more instances of the corresponding microservice associated with the global rate limit with a local rate limit indicating a rate of requests tagged with the corresponding tag associated with the global rate limit allowed to be processed by the instance of the corresponding microservice associated with the global rate limit, wherein the local rate limit of each of the one or more local rate limiters is based on the global rate limit.