Technologies for opportunistic acceleration overprovisioning for disaggregated architectures

One or more machine-readable storage media comprising a plurality of instructions stored thereon that, when executed by a compute device cause the compute device to:

• receive a plurality of job execution requests, each job execution request including a job requested to be accelerated received from an orchestrator server;
• determine one or more job parameters of each requested job based on the corresponding job execution request;
• select an accelerator device of the compute device to execute each job based at least in part on the job parameters of the corresponding job;
• determine, for each job, whether one or more kernels are to be registered on the corresponding accelerator device selected for the corresponding job to enable the corresponding accelerator device to execute the job;
• register, in response to a determination that the one or more kernels are to be registered, the one or more kernels on the corresponding accelerator device;
• and
• schedule, for each accelerator device of the compute device, the kernels of the corresponding accelerator device based on a kernel prediction.

A compute device comprising:

• circuitry for receiving a plurality of job execution requests, each job execution request including a job requested to be accelerated received from an orchestrator server;
• circuitry for determining one or more job parameters of each requested job based on the corresponding job execution request;
• means for selecting an accelerator device of the compute device to execute each job based at least in part on the job parameters of the corresponding job;
• means for determining, for each job, whether one or more kernels are to be registered on the corresponding accelerator device selected for the corresponding job to enable the corresponding accelerator device to execute the job;
• circuitry for registering, in response to a determination that the one or more kernels are to be registered, the one or more kernels on the corresponding accelerator device;
• and
• means for scheduling, for each accelerator device of the compute device, the kernels of the corresponding accelerator device based on a kernel prediction.

A method for overprovisioning accelerator devices of a compute device, the method comprising:

• receiving, by the compute device, a plurality of job execution requests, each job execution request including a job requested to be accelerated received from an orchestrator server;
• determining, by the compute device, one or more job parameters of each requested job based on the corresponding job execution request;
• selecting, by the compute device, an accelerator device of the compute device to execute each job based at least in part on the job parameters of the corresponding job;
• determining, by the compute device and for each job, whether one or more kernels are to be registered on the corresponding accelerator device selected for the corresponding job to enable the corresponding accelerator device to execute the job;
• registering, by the compute device and in response to a determination that the one or more kernels are to be registered, the one or more kernels on the corresponding accelerator device;
• and
• scheduling, for each accelerator device of the compute device and by the compute device, the kernels of the corresponding accelerator device based on a kernel prediction.