Systems, methods, and apparatuses for implementing a scalable scheduler with heterogeneous resource allocation of large competing workloads types using qos

A method performed by system having at least a processor and a memory therein, wherein the method comprises:

• executing a local cache allocated within the memory of the system;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute workload tasks, the computing resources residing within any one of private or public datacenters or third party computing clouds and a plurality of resource characteristics for each of the plurality of computing resources identified;
• filling the local cache with information representing each of the identified computing resources available and the plurality of resource characteristics identified for each of the plurality of computing resources;
• identifying, via a workload discovery engine, pending workload tasks to be scheduled for execution from one or more workload queues;
• updating the local cache with the identified workload tasks;
• identifying, via a policy engine, a Service Level Target (SLT) for each of the workload tasks identified;
• updating the local cache with the SLT for each workload task identified;
• and
• scheduling, via a scheduler, each workload task for execution via one of the computing resources available based on which of the computing resources are estimated to meet the SLT.

Non-transitory computer readable storage media having instructions stored thereon that, when executed by a processor of a system, the instructions cause the system to perform operations including:

• executing a local cache allocated within the memory of the system;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute workload tasks, the computing resources residing within any one of private or public datacenters or third party computing clouds and a plurality of resource characteristics for each of the plurality of computing resources identified;
• filling the local cache with information representing each of the identified computing resources available and the plurality of resource characteristics identified for each of the plurality of computing resources;
• identifying, via a workload discovery engine, pending workload tasks to be scheduled for execution from one or more workload queues;
• updating the local cache with the identified workload tasks;
• identifying, via a policy engine, a Service Level Target (SLT) for each of the workload tasks identified;
• updating the local cache with the SLT for each workload task identified;
• and
• scheduling, via a scheduler, each workload task for execution via one of the computing resources available based on which of the computing resources are estimated to meet the SLT.