Maintaining manageable utilization in a system to prevent excessive queuing of system requests

A computer-implemented method for maintaining manageable utilization in a device, comprising:

• obtaining, during a measurement period, a set of utilization metrics for a system, wherein the utilization metrics for the system includes at least an average number of outstanding system requests N, an average response time R of the system, and a maximum concurrency c, the maximum concurrency c being a maximum number of concurrent requests that the system is capable of processing without using a queue;
• determining, whether the average number of outstanding system requests N of the system lies between a current estimated value of the maximum concurrency c and an actual value of the maximum concurrency c;
• in response to determining that the average number of outstanding system requests N of the system does not lie between the current estimated value of the maximum concurrency c and the actual value of the maximum concurrency c, not adjusting the maximum concurrency value c;
• in response to determining that the average number of outstanding system requests N of the system does lie between the current estimated value of the maximum concurrency c and the actual value of the maximum concurrency c, assigning a value of the maximum concurrency c to be the value of the average number of outstanding system requests N;
• accessing a utilization function which satisfies a black box equation for a utilization ρ value of the system;
• solving the utilization function, wherein the utilization function satisfies a predetermined fixed point relationship;
• and
• managing performance problems of the system indicated by the solving of the utilization function, wherein managing performance problems includes:
• identifying components of the system that exhibit a high utilization and/or instructing performance of an action on components of the system that exhibit a high utilization.

A system for maintaining manageable utilization in a device, comprising:

• a processor;
• and
• logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to:
• obtain, during a measurement period, a set of utilization metrics for a system, wherein the utilization metrics for the system includes at least an average number of outstanding system requests N, an average response time R of the system, and a maximum concurrency c, the maximum concurrency c being a maximum number of concurrent requests that the system is capable of processing without using a queue;
• determine, whether the average number of outstanding system requests N of the system lies between a current estimated value of the maximum concurrency c and an actual value of the maximum concurrency c;
• in response to determining that the average number of outstanding system requests N of the system does not lie between the current estimated value of the maximum concurrency c and the actual value of the maximum concurrency c, not adjust the maximum concurrency value c;
• in response to determining that the average number of outstanding system requests N of the system does lie between the current estimated value of the maximum concurrency c and the actual value of the maximum concurrency c, assign a value of the maximum concurrency c to be the value of the average number of outstanding system requests N;
• access a utilization function which satisfies a black box equation for a utilization ρ value of the system;
• solve the utilization function, wherein the utilization function satisfies a predetermined fixed point relationship;
• and
• manage performance problems of the system indicated by the solving of the utilization function, wherein managing performance problems includes:
• identifying components of the system that exhibit a high utilization and/or instructing performance of an action on components of the system that exhibit a high utilization.