Systems and methods for autoscaling instance groups of computing platforms

A computer-implemented system for scaling an instance group of a computing platform, the system comprising:

• one or more processors;
• and
• a memory storing instructions, the instructions, when executed by the one or more processors, causing the system to perform:
• determining whether to scale up or down the instance group by using historical data from prior jobs wherein the historical data comprises one or more of:
• a data set size used in a prior related job and a code version for a prior related job;
• and
• scaling the instance group up or down based on the determination,
• wherein the determining whether to scale up or down the instance group comprises changing a weighting associated with the historical data based on whether a code version to run a prior job has changed.

A method for scaling an instance group of a computing platform, the method comprising:

• determining a job dependency tree for a plurality of related jobs,
• determining runtime data for each of the jobs in the dependency tree;
• and
• scaling up or down the instance group based on the determined runtime data;
• wherein the scaling up or down the instance group comprises scaling down the instance group by at least:
• waiting for a running pod associated with an instance of the instance group to run to completion;
• and
• detaching the instance from the instance group after the running pod runs to completion.