Real-time simulation of compute accelerator workloads for distributed resource scheduling
AssigneeVMware, Inc.
InventorMatthew D. McClure
Life of this patent
Estimating the term…
Abstract
Disclosed are various embodiments of real-time simulation of the performance of a compute accelerator workload for distributed resource scheduling. The compute accelerator workload is executed on candidate hosts to select a destination host. Efficiency metrics are determined for the candidate hosts based on the execution of the compute accelerator workload on the candidate hosts. A destination host is selected from the candidate hosts based on the efficiency metrics, and the compute accelerator workload can be assigned to execute on the selected destination host.
Claims20
A system, comprising:
- at least one computing device comprising at least one processor and at least one memory;
- and
- machine-readable instructions accessible to the at least one computing device, wherein the instructions, when executed by the at least one processor, cause the at least one computing device to at least:
- suspend execution of a compute accelerator workload at a halting point indicated in a compute kernel of the compute accelerator workload;
- clone the compute accelerator workload and a working set of the compute accelerator workload to a plurality of candidate hosts;
- execute the compute accelerator workload on the plurality of candidate hosts, wherein at least one performance counter for a respective candidate host is incremented during the execution of the compute accelerator workload on the respective candidate host;
- determine a plurality of efficiency metrics corresponding to plurality of candidate hosts based at least in part on the at least one performance counter for the respective candidate host, a respective efficiency metric comprising at least one of:
- a page reference velocity, a page dirty velocity, and an execution velocity;
- and
- migrate the compute accelerator workload to a destination host selected from the plurality of candidate hosts based at least in part on an efficiency metric for the destination host.
A non-transitory, computer-readable medium comprising machine-readable instructions that, when executed by at least one processor, cause at least one computing device to at least:
- identify a compute accelerator workload and a working set for the compute accelerator workload;
- execute the compute accelerator workload on a plurality of candidate hosts to select a destination host for the compute accelerator workload;
- select the destination host from the plurality of candidate hosts based at least in part on a plurality of efficiency metrics corresponding to the plurality of candidate hosts;
- and
- assign the compute accelerator workload to execute on the destination host.
A method, comprising:
- executing a compute accelerator workload on a plurality of candidate hosts to select a destination host for the compute accelerator workload;
- determining a plurality of efficiency metrics corresponding to the plurality of candidate hosts, a respective efficiency metric being determined based at least in part on a performance counter incremented during execution of the compute accelerator workload on a compute accelerator of a respective candidate host;
- selecting the destination host from the plurality of candidate hosts based at least in part on an efficiency metric for the compute accelerator workload on the destination host;
- and
- assigning the compute accelerator workload to execute on the destination host.
Dependencies are inferred from the claim text.