Systems, methods, and apparatuses for implementing a scheduler and workload manager with cyclical service level target (slt) optimization

Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a system having at least a processor and a memory therein, the instructions cause the system to perform operations including:

• allocating a cache within the memory of the system;
• identifying, via a workload discovery engine, pending workload tasks to be scheduled for execution from one or more workload queues and updating the cache;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute the workload tasks and updating the cache;
• executing an SLT updater via the processor of the system, wherein the SLT updater performs at least the following operations:
• (i) identifying multiple SLTs for each of the pending workload tasks based on a current time period, (ii) selecting one of the multiple SLTs to apply to each of the pending workload tasks based on which of the multiple SLTs is determined to be most restrictive, and (iii) updating the cache with information specifying the selected SLT for each pending workload task;
• and
• executing a scheduler via the processor of the system, wherein the scheduler performs at least the following operations:
• (i) retrieving information from the cache specifying the one or more computing resources available to execute workload tasks and specifying the plurality of workload tasks to be scheduled for execution and specifying the selected SLT for each pending workload task and (ii) scheduling the pending workload tasks to execute via the one or more computing resources in compliance with the selected SLT specified for each of the pending workload tasks.

A system to implement a scheduling service, wherein the system comprises:

• a processor and a memory to execute instructions at the system;
• a cache allocated within the memory of the system to store information on behalf of a compute resource discovery engine and a workload discovery engine and a SLT updater and a scheduler;
• wherein the compute resource discovery engine is to identify a plurality of computing resources available to execute the workload tasks and update the cache specifying the identified computing resources;
• wherein the workload discovery engine is to identify pending workload tasks to be scheduled for execution from one or more workload queues and update the cache with the identified workload tasks;
• wherein the SLT updater is to identify multiple SLTs for each of the pending workload tasks based on a current time period and select one of the multiple SLTs to apply to each of the pending workload tasks based on which of the multiple SLTs is determined to be most restrictive, and update the cache with information specifying the selected SLT for each pending workload task;
• wherein the scheduler is to retrieve information from the cache specifying the one or more computing resources available to execute workload tasks and specifying the plurality of workload tasks to be scheduled for execution and specifying the selected SLT for each pending workload task;
• and
• wherein the scheduler is further to schedule the pending workload tasks to execute via the one or more computing resources in compliance with the selected SLT specified for each of the pending workload tasks.