Fine-grained preemption of a data flow architecture based neural processing unit

A system, comprising:

• a neural processing unit;
• and
• a controller coupled to the neural processing unit;
• wherein the controller is capable of executing control-code that implements a first context in the neural processing unit;
• wherein the controller, in response to detecting a preemption opcode in the control-code, is capable of detecting a second context awaiting execution by the neural processing unit and that a priority of the second context is greater than a priority of the first context;
• and
• wherein in response to the detecting, the controller is capable of switching the neural processing unit from the first context to the second context.