Pipeline set selection based on duty cycle estimation of pipeline threads

A computer implemented system for assigning executable jobs to pipeline sets comprising:

• at least one aggregation thread configured to:
• generate a weight for each pipeline set of a plurality of pipeline sets to obtain a plurality of weights, wherein generating the weight for each pipeline set comprises:
• obtaining a plurality of duty cycle metrics for a plurality of pipeline threads in the pipeline set, wherein the plurality of duty cycle metrics comprises a measure of an amount of time that a corresponding pipeline thread is executing and actively processing data, and
• determining the weight for the pipeline set based at least in part on the plurality of duty cycle metrics;
• and
• an assigner executing on a computer processor and configured to:
• assign a job request to a target pipeline set selected from the plurality of pipeline sets according to a weighted random algorithm, wherein the weighted random algorithm uses the plurality of weights.

A non-transitory computer readable medium comprising computer readable program code for performing operations, the operations comprising:

• generating a weight for each pipeline set of a plurality of pipeline sets to obtain a plurality of weights, wherein generating the weight for each pipeline set comprises:
• obtaining a plurality of duty cycle metrics for a plurality of pipeline threads in the pipeline set, wherein the plurality of duty cycle metrics comprises a measure of an amount of time that a corresponding pipeline thread is executing and actively processing data, and
• determining the weight for the pipeline set based on the plurality of duty cycle metrics;
• and
• assigning a new job request to a target pipeline set selected from the plurality of pipeline sets according to a weighted random algorithm, wherein the weighted random algorithm uses the plurality of weights.