Providing an optimized service-based pipeline
AssigneesAdvanced Micro Devices, Inc., ATI Technologies ULC
InventorsDaniel Waihim Wong, Allen J. Porter
Life of this patent
Estimating the term…
Abstract
An optimized service-based pipeline includes a resource manager that receives a request that includes a description of a workload from a workload initiator such as an application. The resource manager identifies runtime utilization metrics of a plurality of processing resources, where the plurality of processing resources includes at least a first graphics processing unit (GPU) and a second GPU. The resource manager determines, based on the utilization metrics and one or more policies, a workload allocation recommendation for the workload. Thus, the workload initiator can determine whether placing a workload on a particular processing resource is preferable based on runtime behavior of the system and policies established of the workload.
Claims20
A method of providing a service-based pipeline, the method comprising:
- inspecting, in response to a request that includes a description of a workload received from a workload initiator, runtime utilization metrics of a plurality of processing resources, wherein the plurality of processing resources includes at least a first graphics processing unit (GPU) and a second GPU;
- generating, by a resource manager and based on the utilization metrics and one or more policies, a workload allocation recommendation;
- and
- providing, to the workload initiator in response to the request, the workload allocation recommendation, wherein the workload initiator is to allocate the workload to one or more of the processing resources for execution by making a call to an operating system.
An apparatus for providing a service-based pipeline, the apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed therein computer program instructions that, when executed by the computer processor, cause the apparatus to:
- inspect, in response to a request that includes a description of a workload received from a workload initiator, runtime utilization metrics of a plurality of processing resources, wherein the plurality of processing resources includes at least a first graphics processing unit (GPU) and a second GPU;
- generate, by a resource manager and based on the utilization metrics and one or more policies, a workload allocation recommendation;
- and
- provide, to the workload initiator in response to the request, the workload allocation recommendation, wherein the workload initiator is to allocate the workload to one or more of the processing resources for execution by making a call to an operating system.
A computer program product for providing a service-based pipeline, the computer program product disposed upon a non-transitory computer readable storage medium, the computer program product comprising computer program instructions that, when executed, cause a computer to:
- inspect, in response to a request that includes a description of a workload received from a workload initiator, runtime utilization metrics of a plurality of processing resources, wherein the plurality of processing resources includes at least a first graphics processing unit (GPU) and a second GPU;
- generate, by a resource manager and based on the utilization metrics and one or more policies, a workload allocation recommendation;
- and
- provide, to the workload initiator in response to the request, the workload allocation recommendation, wherein the workload initiator is to allocate the workload to one or more of the processing resources for execution by making a call to an operating system.
Dependencies are inferred from the claim text.