Technologies for offloading acceleration task scheduling operations to accelerator sleds
AssigneeIntel Corporation
InventorsSusanne M. Balle, Francesc Guim Bernat, Slawomir Putyrski, Joe Grecco, Henry Mitchel, Rahul Khanna, Evan Custodio
Life of this patent
Estimating the term…
Abstract
Technologies for offloading acceleration task scheduling operations to accelerator sleds include a compute device to receive a request from a compute sled to accelerate the execution of a job, which includes a set of tasks. The compute device is also to analyze the request to generate metadata indicative of the tasks within the job, a type of acceleration associated with each task, and a data dependency between the tasks.
Claims15
One or more non-transitory machine-readable storage media comprising a plurality of instructions stored thereon that, in response to being executed, cause one or more processors to:
- execute an orchestrator to:
- receive a request to perform a workload, wherein the workload includes a set of tasks;
- determine availability data of multiple accelerator devices to perform the workload, wherein the availability data is indicative of which of the one or more of the set of tasks are acceptable for execution on an associated accelerator device of the multiple accelerator devices and which of the one or more of the set of tasks are not acceptable for execution on an associated accelerator device of the multiple accelerator devices;
- select one or more of the multiple accelerator devices to perform one or more of the set of tasks based on the availability data and also based on capability to complete the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on a type of acceleration for the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on capability for parallel execution of the one or more of the set of tasks, and wherein the type of acceleration for the one or more of the set of tasks comprises one or more of:
- cryptographic operation or data compression;
- and
- cause execution of the one or more of the set of tasks on the selected one or more of the multiple accelerator devices.
An apparatus comprising:
- an input/output (I/O) subsystem and
- circuitry to:
- receive a request to perform a workload, wherein the workload includes a set of tasks;
- determine availability data of multiple accelerator devices to perform the workload, wherein the availability data is indicative of which of the one or more of the set of tasks are acceptable for execution on an associated accelerator device of the multiple accelerator devices and which of the one or more of the set of tasks are not acceptable for execution on an associated accelerator device of the multiple accelerator devices;
- select one or more of the multiple accelerator devices to perform one or more of the set of tasks based on the availability data and also based on capability to complete the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on a type of acceleration for the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on capability for parallel execution of the one or more of the set of tasks, and wherein the type of acceleration for the one or more of the set of tasks comprises one or more of:
- cryptographic operation or data compression;
- and
- cause execution of the one or more of the set of tasks on the selected one or more of the multiple accelerator devices.
A method comprising:
- receiving a request to perform a workload, wherein the workload includes a set of tasks;
- determining availability data of multiple accelerator devices to perform the workload, wherein the availability data is indicative of which of the one or more of the set of tasks are acceptable for execution on an associated accelerator device of the multiple accelerator devices and which of the one or more of the set of tasks are not acceptable for execution on an associated accelerator device of the multiple accelerator devices;
- selecting one or more of the multiple accelerator devices to perform one or more of the set of tasks based on the availability data and also based on capability to complete the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on a type of acceleration for the one or more of the set of tasks, wherein the capability to complete the one or more of the set of tasks is based on capability for parallel execution of the one or more of the set of tasks, and wherein the type of acceleration for the one or more of the set of tasks comprises one or more of:
- cryptographic operation or data compression;
- and
- causing execution of the one or more of the set of tasks on the selected one or more of the multiple accelerator devices.
Dependencies are inferred from the claim text.