Systems, methods, and apparatuses for implementing a scheduler and workload manager with scheduling redundancy and site fault isolation

Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a system having at least a processor and a memory therein, the instructions cause the system to perform operations including:

• allocating a cache within the memory of the system;
• identifying, via a workload discovery engine, pending workload tasks to be scheduled for execution from one or more workload queues and updating the cache;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute the pending workload tasks and updating the cache;
• and
• executing a scheduler via the processor of the system, wherein the scheduler performs at least the following operations:
• retrieving information from the cache specifying one of the plurality of computing resources available to execute the pending workload tasks and specifying a plurality of the pending workload tasks to be scheduled for execution;
• rating the pending workload tasks based on one or more of a workload type, a specified priority, and current available compute capacity and updating the cache with a rating for each of the pending workload tasks;
• identifying one of the pending workload tasks as a critical workload task based on the information from the cache;
• initiating a redundant execution process for the critical workload task including at least replicating the critical workload task into multiple workload copies and enqueuing the multiple workload copies with the one or more workload queues;
• and
• scheduling the multiple workload copies for execution on different computing resources.

A system to implement a scheduling service, wherein the system comprises:

• a processor and a memory to execute instructions at the system;
• a cache allocated within the memory of the system to store information on behalf of a compute resource discovery engine and a workload discovery engine and a scheduler;
• and
• system logic to cause the system to perform various operations including:
• identifying, via the compute resource discovery engine, a plurality of computing resources available to execute pending workload tasks and updating the cache with the identified plurality of computing resources;
• identifying, via the workload discovery engine, a plurality of the pending workload tasks to be scheduled for execution from one or more workload queues and updating the cache with the identified plurality of the pending workload tasks;
• retrieving, via the scheduler, information from the cache specifying one or more of the plurality of computing resources available to execute the plurality of the pending workload tasks and specifying the plurality of the pending workload tasks to be scheduled for execution;
• rating, via the scheduler, the plurality of the pending workload tasks based on one or more of a workload type, a specified priority, and current available compute capacity and updating the cache with a rating for each of the plurality of the pending workload tasks;
• identifying, via the scheduler, one of the plurality of the pending workload tasks as a critical workload task based on the information from the cache;
• initiating, via the scheduler, a redundant execution process for the critical workload task including at least replicating the critical workload task into multiple workload copies and enqueuing the multiple workload copies with the one or more workload queues;
• and
• scheduling, via the scheduler, the multiple workload copies for execution on different computing resources.