Reducing latency in highly scalable hpc applications via accelerator-resident runtime management
AssigneeAdvanced Micro Devices, Inc.
InventorNicholas James Curtis
Life of this patent
Estimating the term…
Abstract
Methods and systems for runtime management by an accelerator-resident manager. Techniques include receiving, by the manager, a representation of a processing flow of an application, including a plurality of kernels and respective dependencies. The manager, then, assigns the plurality of kernels to one or more APUs managed it and launches the plurality of kernels on their assigned APUs to run in an iteration according to the respective dependencies.
Claims20
A method for runtime management by an accelerator-resident manager, comprising:
- receiving, by the manager, a representation of a processing flow of an application, including a plurality of kernels and respective dependencies;
- assigning, by the manager, the plurality of kernels to one or more APUs of an accelerator managed by the manager;
- and
- launching, by the manager, the plurality of kernels on their assigned APUs to run in an iteration according to the respective dependencies.
A system for runtime management by an accelerator-resident manager, comprising:
- at least one processor;
- and
- memory storing instructions that, when executed by the at least one processor, cause the system to:
- receive, by the manager, a representation of a processing flow of an application, including a plurality of kernels and respective dependencies;
- assign, by the manager, the plurality of kernels to one or more APUs of an accelerator managed by the manager;
- and
- launch, by the manager, the plurality of kernels on their assigned APUs to run in an iteration according to the respective dependencies.
A non-transitory computer-readable medium comprising instructions executable by at least one processor to perform a method for runtime management by an accelerator-resident manager, the method comprising:
- receiving, by the manager, a representation of a processing flow of an application, including a plurality of kernels and respective dependencies;
- assigning, by the manager, the plurality of kernels to one or more APUs managed by the manager;
- and
- launching, by the manager, the plurality of kernels on their assigned APUs to run in an iteration according to the respective dependencies.
Dependencies are inferred from the claim text.