Interface for multiple processors
AssigneeNVIDIA Corporation
InventorsLopamudra Kundu, Elena Agostini
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to interface with an accelerator. In at least one embodiment, an application provides workloads to a logical device, and the logical device distributes the workloads across a plurality of accelerators.
Claims37
A non-transitory machine-readable medium having stored thereon executable instructions, which if performed by one or more processors, cause the one or more processors to, in response to an application programming interface (API) call, at least:
- identify a workflow submitted via the API call, the workflow comprising two or more workloads to be performed sequentially, each workload corresponding to a profile describing resource requirements and a type of accelerator to perform a corresponding workload;
- select at least two accelerators from a plurality of accelerators to perform the two or more workloads based at least in part on respective profiles of the two or more workloads;
- cause a first workload of the two or more workloads to be scheduled to be performed by a first accelerator of the at least two accelerators;
- and
- wherein the first accelerator is to use information in the workflow submitted via the API call to forward intermediate results computed by the first accelerator in performing the first workload to a second accelerator of the at least two accelerators.
A computer system comprising one or more processors and machine-readable media to store executable instructions that, as a result of being performed by the one or more processors, cause the computer system to, in response to an application programming interface (API) call:
- identify a workflow submitted via the API call, the workflow comprising two or more workloads to be performed sequentially, each workload corresponding to a profile describing resource requirements and type of accelerator to perform a corresponding workload;
- select at least two accelerators from a plurality of accelerators to perform the two or more workloads based at least in part on respective profiles of the two or more workloads;
- and
- cause a first workload of the two or more workloads to be scheduled to be performed by a first accelerator of the at least two accelerators;
- wherein the first accelerator is to use information in the workflow submitted via the API call to forward intermediate results computed by the first accelerator in performing the first workload to a second accelerator of the at least two accelerators.
A computer-implemented method, comprising:
- receiving an application programming interface (API) call;
- and
- in response to receipt of the API call:
- identifying a workflow submitted via the API call, the workflow comprising two or more workloads to be performed sequentially, each workload corresponding to a profile describing resource requirements and a type of accelerator to perform a corresponding workload;
- selecting at least two accelerators from a plurality of accelerators to perform the two or more workloads based at least in part on respective profiles of the two or more workloads;
- and
- causing a first workload of the two or more workloads to be scheduled to be performed by a first accelerator of the at least two accelerators;
- wherein the first accelerator is to use information in the workflow submitted via the API call to forward intermediate results computed by the first accelerator in performing the first workload to a second accelerator of the at least two accelerators.
One or more processors, comprising:
- circuitry to, in response to an application programming interface (API) call:
- identify a workflow submitted via the API call, the workflow comprising two or more workloads to be performed sequentially, each workload corresponding to a profile describing resource requirements and a type of accelerator to perform a corresponding workload;
- select at least two accelerators from a plurality of accelerators to perform the two or more workloads based at least in part on respective profiles of the two or more workloads;
- and
- cause a first workload of the two or more workloads to be scheduled to be performed by a first accelerator of the at least two accelerators;
- wherein the first accelerator is to use information in the workflow submitted via the API call to forward intermediate results computed by the first accelerator in performing the first workload to a second accelerator of the at least two accelerators.
Dependencies are inferred from the claim text.