Systems, methods, and apparatuses for implementing a scheduler and workload manager that identifies and consumes global virtual resources

Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a system having at least a processor and a memory therein, the instructions cause the system to perform operations including:

• allocating a cache within the memory of the system;
• identifying, via a workload discovery engine, a plurality of pending workload tasks to be scheduled for execution from one or more workload queues and updating the cache;
• identifying, via a compute resource discovery engine, a plurality of computing resources available to execute the plurality of pending workload tasks and updating the cache;
• identifying, via a virtual capacity discovery engine, a plurality of virtual resources available to a scheduler in support of executing the plurality of pending workload tasks and updating the cache;
• executing the scheduler via the processor of the system, wherein the scheduler performs at least the following operations:
• retrieving information from the cache specifying (i) one or more of the plurality of computing resources available to execute the plurality of pending workload tasks and (ii) the plurality of pending workload tasks to be scheduled for execution and (iii) the plurality of virtual resources available;
• determining, for each of the plurality of pending workload tasks to be scheduled, any virtual resource requirements to execute a respective workload task;
• selecting one of the plurality of pending workload tasks for execution based on both (i) a computing resource being available to execute the selected one of the plurality of pending workload tasks and based further on (ii) a virtual resource required for execution of the selected one of the plurality of pending workload tasks being available within a virtual resource pool;
• and
• scheduling the selected one of the plurality of pending workload tasks for execution with the computing resource and allocating the virtual resource exclusively to the computing resource for the duration of execution of the selected one of the plurality of pending workload tasks.

A system to implement a scheduling service, wherein the system comprises:

• a processor and a memory to execute instructions at the system;
• a cache allocated within the memory of the system to store information on behalf of a compute resource discovery engine and a workload discovery engine and a virtual capacity discovery engine and a scheduler;
• and
• system logic to cause the system to perform various operations including:
• identifying, via the workload discovery engine, a plurality of pending workload tasks to be scheduled for execution from one or more workload queues and update the cache with the identified plurality of pending workload tasks;
• identifying, via the compute resource discovery engine, a plurality of computing resources available to execute the plurality of pending workload tasks and update the cache specifying the identified plurality of computing resources;
• identifying, via the virtual capacity discovery engine, a plurality of virtual resources available to the scheduler in support of executing the plurality of pending workload teaks and update the cache specifying the identified plurality of computing resources;
• retrieving, via the scheduler, information from the cache specifying (i) one or more of the plurality of computing resources available to execute the plurality of pending workload tasks and (ii) the plurality of pending workload tasks to be scheduled for execution and (iii) the plurality of virtual resources available;
• determining, via the scheduler, for each of the plurality of pending workload tasks to be scheduled, any virtual resource requirements to execute a respective workload task;
• selecting, via the scheduler, one of the plurality of pending workload tasks for execution based on both (i) a computing resource being available to execute the selected one of the plurality of pending workload tasks and based further on (ii) a virtual resource required for execution of the selected one of the plurality of pending workload tasks being available within a virtual resource pool;
• and
• scheduling, via the scheduler, the selected one of the plurality of pending workload tasks for execution with the computing resource and allocating the virtual resource exclusively to the computing resource for the duration of execution of the selected one of the plurality of pending workload tasks.