Concurrent workload scheduling with multiple level of dependencies

A method comprising:

• a graphics processing unit (GPU) performing:
• accessing a command buffer, wherein the command buffer comprises a plurality of commands, wherein the plurality of commands are based on a sequence of commands, wherein a central processing unit (CPU)-executed driver for the GPU replaced semaphore wait commands from the sequence of commands with commands that cause one or more of:
• check if execution of a node has occurred or check if one or more dependencies of the node have completed and wherein at least one command of the plurality of commands is dependent on completion of at least one other command of the plurality of commands and the command buffer comprises a jump command of the plurality of commands to cause a jump to a location in the command buffer based on a status associated with the jump command being met,
• based on execution of the jump command, the GPU selecting and executing a command of the plurality of commands at the location in the command buffer, and
• based on the status not being met, the GPU performing a command of the plurality of commands associated with a next sequential location in the command buffer, wherein the at least one command of the plurality of commands that is dependent on completion of at least one other command comprises a thread spawn command to cause one or more of:
• memory copy, video decoding, video encoding, or drawing a 3D triangle.

At least one non-transitory computer-readable medium comprising instructions stored thereon, that if executed by a processor, cause the processor to:

• execute a driver for a graphics processing unit (GPU) that is to:
• generate a sequence of commands;
• replace semaphore wait commands in the sequence of commands with commands that cause one or more of:
• check if execution of a node has occurred or check if one or more dependencies of the node have completed;
• and
• store a plurality of commands in a command buffer in memory for execution by the GPU, wherein:
• the plurality of commands in the command buffer include the commands that cause one or more of:
• check if execution of a node has occurred or check if one or more dependencies of the node have completed,
• at least one command of the plurality of commands is dependent on completion of at least one other command of the plurality of commands and the command buffer comprises a jump command of the plurality of commands to cause a jump to a location in the command buffer based on a status associated with the jump command being met,
• based on execution of the jump command, the GPU is to select and execute a command of the plurality of commands at the location in the command buffer,
• based on the status not being met, the GPU is to perform a command of the plurality of commands associated with a next sequential location in the command buffer, and
• the at least one command of the plurality of commands that is dependent on completion of at least one other command comprises a thread spawn command to cause one or more of:
• memory copy, video decoding, video encoding, or drawing a 3D triangle.