Processing unit for performing operations of a neural network

A method comprising:

• receiving an instruction to perform a first operation on a first layer of a neural network;
• receiving block dependency data;
• receiving an instruction to perform a second operation on a second layer of the neural network;
• performing the first operation comprising dividing the first layer into a plurality of input blocks, and operating on the input blocks to generate a plurality of output blocks;
• and
• performing the second operation after the first operation has generated a set number of output blocks, the set number being defined by the block dependency data.

A system comprising a first processing unit, and a second processing unit, wherein:

• the first processing unit outputs a command stream to the second processing unit;
• the command stream comprises an instruction to perform a first operation on a first layer of a neural network, block dependency data, and an instruction to perform a second operation on a second layer of the neural network;
• and
• in response to the command stream, the second processing unit:
• performs the first operation comprising dividing the first layer into a plurality of input blocks, and operating on the input blocks to generate a plurality of output blocks;
• and
• performs the second operation after the first operation has generated a set number of output blocks, the set number being defined by the block dependency data.