Optimizing Computing Resource Allocation for Different Artificial Intelligence Workloads

A computer system comprising:

• a processor set;
• one or more computer-readable storage media;
• and
• program instructions stored on the one or more computer-readable storage media to cause the processor set to perform operations comprising:
• generating time series predictions of future allocation of number and type of computing resources needed on a compute node to run an Artificial Intelligence (AI) workload based on real-time performance data corresponding to the AI workload running on the compute node;
• determining whether runtime computing resource reallocation is needed on the compute node based on the time series predictions of the future allocation of the number and the type of the computing resources needed on the compute node to run the AI workload;
• and
• responsive to determining that the runtime computing resource reallocation is needed on the compute node based on the time series predictions of the future allocation of the number and the type of the computing resources needed on the compute node to run the AI workload, performing the runtime computing resource reallocation on the compute node automatically to adjust at least one of the number and the type of the computing resources needed on the compute node to run the AI workload.

A computer program product comprising:

• one or more computer-readable storage media;
• and
• program instructions stored on the one or more computer-readable storage media to perform operations comprising:
• generating time series predictions of future allocation of number and type of computing resources needed on a compute node to run an Artificial Intelligence (AI) workload based on real-time performance data corresponding to the AI workload running on the compute node;
• determining whether runtime computing resource reallocation is needed on the compute node based on the time series predictions of the future allocation of the number and the type of the computing resources needed on the compute node to run the AI workload;
• and
• responsive to determining that the runtime computing resource reallocation is needed on the compute node based on the time series predictions of the future allocation of the number and the type of the computing resources needed on the compute node to run the AI workload, performing the runtime computing resource reallocation on the compute node automatically to adjust at least one of the number and the type of the computing resources needed on the compute node to run the AI workload.