Neural network processor and method

A neural network processor comprising:

• a plurality of N processing elements, PEs, coupled to a first layer switch network;
• a plurality of N memory zones, each memory zone comprising a plurality of zone memories coupled to a respective second layer switch network, each second layer switch network coupled to the first layer switch network;
• a data mover coupled to the first layer switch network and configured to be coupled to a system memory;
• wherein the plurality of processing elements are configured to process layers of a neural network in a plurality of lock-step cycles during a compute phase and wherein in each lock-step cycle of the plurality of lock-step cycles:
• a first set of zone memories within each zone are configured to store neural network layer input data;
• a second set of zone memories within each zone are configured to store neural network layer weights;
• a third set of zone memories within each zone are configured to store neural network layer results;
• and
• each processing element of the plurality of processing elements is configured to exclusively access the first set of zone memories, the second set of zone memories and the third set of zone memories in at least one memory zone of the plurality of memory zones.