Techniques to generate execution schedules from neural network computation graphs

At least one non-transitory computer-readable medium comprising a set of instructions that, in response to being executed by a processor circuit, cause the processor circuit to:

• add a first non-barrier task (NBT) from a schedulable task list to a working task schedule (WTS) utilized in production of an execution schedule for an inference process for a neural network application;
• determine the first NBT is an upstream dependency of a first barrier task (BT) based on a computation graph comprising BTs and NBTs, wherein the BTs correspond to hardware barriers utilized during performance of the inference process;
• reduce an upstream dependency count (UDC) associated with a first BT by a defined value from a current count value based on a determination the first NBT is an upstream dependency of the first BT;
• determine the UDC associated with the first BT is zero;
• and
• add each NBT that is a downstream dependency of the first BT to a tasks to schedule (TTS) list based on the determination of the UDC associated with the first BT is zero.

A computer-implemented method comprising:

• adding a first non-barrier task (NBT) from a schedulable task list to a working task schedule (WTS) utilized in production of an execution schedule for an inference process for a neural network application;
• determining the first NBT is an upstream dependency of a first barrier task (BT) based on a computation graph comprising BTs and NBTs, wherein the BTs correspond to hardware barriers utilized during performance of the inference process;
• reducing an upstream dependency count (UDC) associated with a first BT by a defined value from a current value based on a determination the first NBT is an upstream dependency of the first BT;
• determining the UDC associated with the first BT is zero;
• and
• adding each NBT that is a downstream dependency of the first BT to a tasks to schedule (TTS) list based on the determination of the UDC associated with the first BT is zero.