Reliable and scalable multi-tenant asynchronous processing

A system for handling client requests in a multi-tenant environment, comprising:

• a group of web servers configured to:
• receive a request for processing from a client;
• determine whether the request is for synchronous processing;
• if the request is for synchronous processing, handle the request at a receiving server and provide a response to the requesting client;
• and
• if the request is for asynchronous processing, determine which organization database is applicable for the request and place the request in a queue associated with the organization database;
• a group of organization databases configured to store information for organizations participating in the multi-tenant environment, wherein each client is associated with at least one organization;
• a group of asynchronous processing servers configured to:
• receive the request from the queue based on a prioritization algorithm;
• and
• process the request receiving data associated with the request from the organization database;
• and
• a locator service configured to provide information associated with a selection of a relevant organization database and a purpose of the service to be provided to the requesting client to at least one of the web servers and the asynchronous processing servers.

A computer-readable storage medium with instructions stored thereon for handling user requests in a multi-tenant hosted business application environment, the instructions comprising:

• receiving a request for processing from a user by a web server based on a selection among a group of web servers employing one of a random selection and a load balancing algorithm;
• determining whether the request is for synchronous processing;
• if the request is for synchronous processing, handling the request at the web server and providing a response to the requesting user;
• if the request is for asynchronous processing, determining an applicable organization database for the request based on information received from a locator service and placing the request in a queue associated with the organization database;
• providing the request from the queue to an asynchronous server based on a prioritization algorithm;
• processing the request at the asynchronous server using data from the organization database;
• and
• enabling the asynchronous server to pull the request from the queue based on a quota allocated to each organization depending on historic load information for organizations with pending requests in addition to the prioritization algorithm.