Multistep automated scaling for cluster containers

A method for managing a cluster computing system, comprising:

• storing a resource usage history for a set of tasks running on a computer cluster comprising a plurality of worker systems;
• determining, using a processor, a required resource size for a task of the set of tasks based at least in part on the resource usage history for the task;
• is resizing resources allocated to the task to the required resource size;
• arranging the set of tasks on the plurality of worker systems to reduce a number of worker systems running tasks;
• and
• deallocating worker systems no longer running tasks.

A computer program product for managing a cluster computing system, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

• storing a resource usage history for a set of tasks running on a computer cluster comprising a plurality of worker systems;
• determining a required resource size for a task of the set of tasks based at least in part on the resource usage history for the task;
• resizing resources allocated to the task to the required resource size;
• arranging the set of tasks on the plurality of worker systems to reduce a number of worker systems running tasks;
• and
• deallocating worker systems no longer running tasks.