System and method for scheduling machine learning jobs

A method for scheduling machine learning jobs, the method performed by a computing device comprising a hardware processor, the method comprising:

• receiving job information including information indicative of a checkpoint file of a model to be executed and required resource information, wherein the checkpoint file is a file output by a machine learning framework for storing the model;
• determining an expected execution time of the model using memory usage for executing the model after calculating the memory usage, using information on the checkpoint file;
• and
• automatically performing job scheduling for the model, using the expected execution time of the model and the required resource information.

A computer program coupled to a computing device comprising a processor and a computer-readable medium storing the computer program, the computer program includes instructions for:

• receiving job information including information indicative of a checkpoint file of a model to be executed and required resource information, wherein the checkpoint file is a file output by a machine learning framework for storing the model;
• determining an expected execution time of the model to be executed using memory usage after calculating the memory usage necessary for executing the model using information of the checkpoint file;
• and
• automatically performing job scheduling for the model using the expected execution time of the model and the required resource information.