Online incremental scaling of a compute cluster

A system for scaling a cluster, comprising:

• a processor;
• a memory device that stores program code structured to cause the processor to:
• determine, by analyzing a workload graph, a first resource demand that satisfies a first concurrency requirement of first tasks schedulable on a first subset of the cluster;
• determine a first cluster size to satisfy the determined first resource demand;
• determine a first target size for the first subset based on the determined first cluster size;
• determine that a current size of the first subset satisfies a first predetermined relationship with the first target size;
• designate a first node of the first subset for downscaling;
• schedule new first tasks on nodes of the first subset that are not designated for downscaling;
• and
• remove the designated first node from the cluster subsequent to all tasks on the designated first node completing execution.

A computer-readable storage medium comprising computer-executable instructions, that when executed by a processor, cause the processor to:

• determine, by analyzing a workload graph, a first resource demand that satisfies a first concurrency requirement of first tasks schedulable on a first subset of the cluster;
• determine a first cluster size to satisfy the first resource demand;
• determine a first target size for the first subset based on the first cluster size;
• determine that a current size of the first subset satisfies a first predetermined relationship with the first target size;
• designate a first node of the first subset for downscaling;
• schedule new first tasks on nodes of the first subset that are not designated for downscaling;
• and
• remove the designated first node from the cluster subsequent to all tasks on the designated first node completing execution.