Systems and techniques for utilizing resource aware queues and/or service sharing in a multi-server environment

An article comprising a non-transitory computer-readable medium having stored thereon instructions that when executed by one or more processors of an application server of a plurality of application servers are configurable to service requests by:

• employing a traffic light metaphor to represent a utilization level of each of a plurality of resources of the application server by associating a traffic light of a plurality of traffic lights with each resource of the plurality of resources;
• maintaining a mapping that associates a particular service request directed to the application server with a set of affected traffic lights of the plurality of traffic lights;
• facilitating throttling of service requests directed to the application server that involve a resource of the plurality of resources that is under pressure by maintaining a deferred queue of a plurality of deferred queues for each traffic light of the plurality of traffic lights;
• responsive to receiving a service request directed to the application server, adding directly or indirectly, based on a priority associated with the service request, the service request to a queue of a plurality of queues maintained in front of the application server;
• and
• servicing service requests from the plurality of queues in accordance with a priority associated with each of the plurality of queues.

An application server comprising:

• a non-transitory storage device having embodied therein instructions;
• and
• one or more processors coupled to the non-transitory storage device and operable to execute the instructions to perform a method comprising:
• employing a traffic light metaphor to represent a utilization level of each of a plurality of resources of the application server by associating a traffic light of a plurality of traffic lights with each resource of the plurality of resources;
• maintaining a mapping that associates a particular service request directed to the application server with a set of affected traffic lights of the plurality of traffic lights;
• facilitating throttling of service requests directed to the application server that involve a resource of the plurality of resources that is under pressure by maintaining a deferred queue of a plurality of deferred queues for each traffic light of the plurality of traffic lights;
• responsive to receiving a service request directed to the application server, adding directly or indirectly, based on a priority associated with the service request, the service request to a queue of a plurality of queues maintained in front of the application server;
• and
• servicing service requests from the plurality of queues in accordance with a priority associated with each of the plurality of queues.