Detection of resource bottlenecks in execution of workflow tasks using provenance data

A system, comprising:

• a memory;
• and
• at least one processing device, coupled to the memory, operative to implement the following steps:
• obtaining a state of multiple workflow executions of a plurality of concurrent workflows in a shared infrastructure environment, wherein said multiple workflow executions are performed with a plurality of different resource allocation configurations, wherein said state comprises provenance data of said multiple workflow executions and wherein each of said multiple workflow executions is comprised of one or more tasks;
• obtaining a first signature execution trace of at least one task within the plurality of concurrent workflows representing a first resource allocation configuration, and a second signature execution trace of said at least one task within the plurality of concurrent workflows representing a second resource allocation configuration;
• identifying a first sequence of time intervals in said first signature execution trace for said at least one task that corresponds to a second sequence of time intervals in said second signature execution trace for said at least one task based on a similarity metric;
• and
• identifying a given time interval in said first and second corresponding sequences of time intervals for said at least one task as a resource bottleneck of one or more resources that differ between said first resource allocation configuration and said second resource allocation configuration based on a change in execution time for the given time interval between the first signature execution trace and the second signature execution trace.

A computer program product, comprising a tangible machine-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by at least one processing device perform the following steps:

• obtaining a state of multiple workflow executions of a plurality of concurrent workflows in a shared infrastructure environment, wherein said multiple workflow executions are performed with a plurality of different resource allocation configurations, wherein said state comprises provenance data of said multiple workflow executions and wherein each of said multiple workflow executions is comprised of one or more tasks;
• obtaining a first signature execution trace of at least one task within the plurality of concurrent workflows representing a first resource allocation configuration, and a second signature execution trace of said at least one task within the plurality of concurrent workflows representing a second resource allocation configuration;
• identifying a first sequence of time intervals in said first signature execution trace for said at least one task that corresponds to a second sequence of time intervals in said second signature execution trace for said at least one task based on a similarity metric;
• and
• identifying a given time interval in said first and second corresponding sequences of time intervals for said at least one task as a resource bottleneck of one or more resources that differ between said first resource allocation configuration and said second resource allocation configuration based on a change in execution time for the given time interval between the first signature execution trace and the second signature execution trace.