Systems and methods for managing application requests

A server device comprising:

• a processor;
• and
• a non-volatile memory storing computer program code that when executed on the processor causes the processor to execute a process including:
• receiving a request by an application programming interface (API) of the server device, wherein servicing of the request involves use of one or more resources external to the server;
• determining, by a filter of the server device, a type of the request;
• sending, by the filter, the request to a controller selected from a plurality of controllers of the server device based on the request type, where different ones of the plurality of controllers are configured to service different types of API requests;
• and
• determining, by the controller, how to handle the request as one of:
• servicing the request,
• enqueuing the request, or
• rejecting the request,
• wherein the determining of how to handle the request is based at least in part upon a rate of recent request traffic received by the controller.

A non-transitory machine-readable medium encoding instructions that when executed by one or more processors cause a process to be carried out, the process comprising:

• receiving a request by an application programming interface (API) of a server device, wherein servicing of the request involves use of one or more resources external to the server;
• determining, by a filter of the server device, a type of the request;
• sending, by the filter, the request to a controller selected from a plurality of controllers of the server device based on the request type, where different ones of the plurality of controllers are configured to service different types of API requests;
• and
• determining, by the controller, how to handle the request as one of:
• servicing the request,
• enqueuing the request, or
• rejecting the request,
• wherein the determining of how to handle the request is based at least in part upon a rate of recent request traffic received by the controller.