Back to results
US 10,068,306 B2Granted
Facilitating dynamic pipelining of workload executions on graphics processing units on computing devices
AssigneeIntel Corporation
InventorsJayanth N. Rao, Pavan K. Lanka
Life of this patent
Estimating the term…
Abstract
A mechanism is described for facilitating dynamic pipelining of workload executions at graphics processing units on computing devices. A method of embodiments, as described herein, includes generating a command buffer having a plurality of kernels relating to a plurality of workloads to be executed at a graphics processing unit (GPU), and pipelining the workloads to be processed at the GPU, where pipelining includes scheduling each kernel to be executed on the GPU based on at least one of availability of resource threads and status of one or more dependency events relating to each kernel in relation to other kernels of the plurality of kernels.
Claims19
An apparatus comprising:
- a processing device coupled to memory, wherein the processing device facilitates:
- coalescing kernels logic to generate a command buffer having a plurality of kernels relating to a plurality of workloads to be processed by a graphics processor;
- dependency checking logic to check, in runtime, availability of resource threads of the graphics processor that remain idle due to one or more pending dependency contingencies associated with one or more kernels of one or more workloads in relation to other kernels of the plurality of kernels of the command buffer;
- and
- state management logic to acquire, in runtime, one or more idle resource threads to facilitate pipelining of other workloads in parallel execution based on the other kernels that do not have one or more pending dependency contingencies, wherein the other workloads are processed by the graphics processor using the one or more idle resource threads without having to stall the graphics processor for processing of the one or more workloads based on the one or more kernels and without seeking resolution of the one or more pending dependency contingencies associated with the one or more kernels, and
- wherein the state management logic is further to set up interface descriptors for the plurality of kernels prior to processing the respective kernel and wherein the dependency checking logic checks availability, in part, by loading a descriptor by returning the data last written by the respective kernel, and wherein the state management logic pushes a write cycle in a pipelined workload based on a subsequent read as determined using a respective interface descriptor.
3 more elements
A method comprising:
- generating a command buffer having a plurality of kernels relating to a plurality of workloads to be processed by a graphics processor;
- setting up interface descriptors for the plurality of kernels prior to processing the respective kernels;
- checking, in runtime, availability of resource threads that remain idle due to one or more pending dependency contingencies associated with one or more kernels of one or more workloads in relation to other kernels of the plurality of kernels of the command buffer, wherein the availability is checked, in part, by loading a descriptor by returning the data last written by the respective kernel;
- and
- acquiring, in runtime, one or more idle resource threads based on the availability of resource threads to facilitate pipelining of other workloads in parallel execution based on the other kernels that do not have one or more pending dependency contingencies, wherein the other workloads are processed by the graphics processor using the one or more idle resource threads without having to stall the graphics processor for processing of the one or more workloads based on the one or more kernels and without seeking resolution of the one or more pending dependency contingencies associated with the one or more kernels, and wherein a write cycle is pushed in a pipelined workload based on a subsequent read as determined using a respective interface descriptor.
2 more elements
At least one non-transitory machine-readable medium comprising a plurality of instructions, executed on a computing device, to facilitate the computing device to perform one or more operations comprising:
- generating a command buffer having a plurality of kernels relating to a plurality of workloads to be processed by a graphics processor;
- setting up interface descriptors for the plurality of kernels prior to processing the respective kernels;
- checking, in runtime, availability of resource threads that remain idle due to one or more pending dependency contingencies associated with one or more kernels of one or more workloads in relation to other kernels of the plurality of kernels of the command buffer, wherein the availability is checked, in part, by loading a descriptor by returning the data last written by the respective kernel;
- and
- acquiring, in runtime, one or more idle resource threads based on the availability of resource threads to facilitate pipelining of other workloads in parallel execution based on the other kernels that do not have one or more pending dependency contingencies, wherein the other workloads are processed by the graphics processor using the one or more idle resource threads without having to stall the graphics processor for processing of the one or more workloads based on the one or more kernels and without seeking resolution of the one or more pending dependency contingencies associated with the one or more kernels, and wherein a write cycle is pushed in a pipelined workload based on a subsequent read as determined using a respective interface descriptor.
2 more elements
Dependencies are inferred from the claim text.