Dynamic learning based resource utilization fairness in a cloud multi-tenant environment

A method comprising:

• generating, by a multi-tenant application, one or more page size recommendations and one or more sequential request count recommendations for one or more calls to an external database;
• combining a first page size recommendation with a ruleset-based page size value to generate a page size, wherein the page size specifies a number of records to retrieve from the external database;
• determining in which fairness mode to operate in based on one or more conditions, wherein the fairness mode sets weighting factor values for applying to the first page size recommendation and the ruleset-based page size value when being combined to generate the page size;
• performing, by the multi-tenant application, a first call to the external database using the page size;
• and
• performing, in a sequential manner by the multi-tenant application, the first call and a number of subsequent calls to the external database, wherein the number of subsequent calls is based on a first sequential request count recommendation.

A non-transitory computer-readable medium storing instructions, which when executed by at least one processor, cause operations comprising:

• generating, by a multi-tenant application, one or more page size recommendations and one or more sequential request count recommendations for one or more calls to an external database;
• combining a first page size recommendation with a ruleset-based page size value to generate a page size, wherein the page size specifies a number of records to retrieve from the external database;
• determining in which fairness mode to operate in based on one or more conditions, wherein the fairness mode sets weighting factor values for applying to the first page size recommendation and the ruleset-based page size value when being combined to generate the page size;
• performing, by the multi-tenant application, a first call to the external database using the page size;
• and
• performing, in a sequential manner by the multi-tenant application, the first call and a number of subsequent calls to the external database, wherein the number of subsequent calls is based on a first sequential request count recommendation.

A system, comprising:

• at least one processor;
• and
• at least one memory including program instructions which when executed by the at least one processor causes operations comprising:
• generating, by a multi-tenant application, one or more page size recommendations and one or more sequential request count recommendations for one or more calls to an external database;
• performing, by the multi-tenant application, a first call to the external database using a page size which is based on a first page size recommendation, wherein the page size specifies a number of records to retrieve from the external database;
• and
• performing, in a sequential manner by the multi-tenant application, the first call and a number of subsequent calls to the external database, wherein the number of subsequent calls is based on a first sequential request count recommendation,
• wherein the first call and the number of subsequent calls are performed to the external database for a single client by the multi-tenant application without any intervening calls being made to the external database by the multi-tenant application for any other clients.