Resource bottleneck identification for multi-stage workflows processing

A computer readable storage device storing a program of instructions executable by a machine to perform a method of identifying resource bottleneck in multi-stage workflow processing, the method comprising:

• identifying dependencies between logical stages and physical resources in a computing system to determine which logical stage involves what set of resources;
• for each of the identified dependencies, determining a functional relationship between a usage level of a physical resource and a concurrency level of a logical stage;
• estimating consumption of the physical resources by each of the logical stages based on the functional relationship determined for each of the logical stages;
• and
• performing a predictive modeling based on the estimated consumption to determine a concurrency level at which said each of the logical stages will become bottleneck.

A system for identifying resource bottleneck in multi-stage workflow processing, comprising:

• a computer processor;
• a module operable to execute on the computer processor and further operable to identify dependencies between logical stages and physical resources in a computing system to determine which logical stage involves what set of resources,
• for each of the identified dependencies, the module further operable to determine a functional relationship between a usage level of a physical resource and a concurrency level of a logical stage,
• the module further operable to estimate consumption of the physical resources by each of the logical stages based on the functional relationship determined for each of the logical stages, and
• the module further operable to perform a predictive modeling based on the estimated consumption to determine a concurrency level at which said each of the logical stages will become bottleneck.