Method and system for workload management for data management systems

A non-transitory machine readable medium storing a program which when executed on set of processing units of a host computer shares a limited number of database connections with a larger number of clients, the program comprising a set of instructions for:

• maintaining a plurality of incoming connections to a plurality of databases to process queries from a plurality of N clients, wherein N is a number;
• defining a plurality of M queuing pools, each queuing pool associated with at least one database and providing one or more outgoing connections to the associated database, wherein:
• M is a number smaller than N;
• and
• each queuing pool is characterized by a number of concurrent connections an instance of the pool permits to the associated database;
• selecting a queuing pool to store queries for each incoming connection from the plurality of clients, wherein at least one queuing pool is used to store queries from at least two different clients, said queuing pools used to reduce a number of connections to the plurality of databases by requiring the databases to have connections with the smaller number of M queuing pools rather than the larger number of N clients;
• forwarding queries from the queuing pools to the databases associated with the queuing pools;
• and
• providing responses to the clients based on responses that the databases provide to the forwarded queries.