Systems, methods, and apparatuses for implementing a scheduler and workload manager with workload re-execution functionality for bad execution runs

Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a system having at least a processor and a memory therein, the instructions cause the system to perform operations including:

• allocating a cache within the memory of the system;
• identifying, via a workload discovery engine, pending workload tasks to be scheduled for execution from one or more workload queues and updating the cache;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute the workload tasks and updating the cache;
• identifying, via an external services monitor, a plurality of external services accessible to the workload tasks and updating the cache;
• executing a scheduler via the processor of the system, wherein the scheduler performs at least the following operations:
• scheduling the workload tasks for execution on the plurality of computing resources;
• identifying a failure condition for one of the plurality of external services accessible to the workload tasks;
• identifying any of the workload tasks potentially affected by the failure condition of the external service based on the workload tasks specifying the external service as a dependency and based further on execution of the workload tasks overlapping in time with a time frame associated with the failure condition;
• and
• scheduling the workload tasks potentially affected by the failure condition of the external service for a repeated execution on the plurality of computing resources.

A system to implement a scheduling service, wherein the system comprises:

• a processor and a memory to execute instructions at the system;
• a cache allocated within the memory of the system to store information on behalf of a compute resource discovery engine and a workload discovery engine and an external services monitor and a scheduler;
• wherein the compute resource discovery engine is to identify a plurality of computing resources available to execute the workload tasks and update the cache specifying the identified computing resources;
• wherein the workload discovery engine is to identify pending workload tasks to be scheduled for execution from one or more workload queues and update the cache with the identified workload tasks;
• wherein the external services monitor is to identify a plurality of external services accessible to the workload tasks and update the cache with the plurality of external services;
• wherein the scheduler is to schedule the workload tasks for execution on the plurality of computing resources;
• wherein the scheduler is to schedule identify a failure condition for one of the plurality of external services accessible to the workload tasks;
• wherein the scheduler is to schedule identify any of the workload tasks potentially affected by the failure condition of the external service based on the workload tasks specifying the external service as a dependency and based further on execution of the workload tasks overlapping in time with a time frame associated with the failure condition;
• and
• wherein the scheduler is further to schedule the workload tasks potentially affected by the failure condition of the external service for a repeated execution on the plurality of computing resources.