High bandwidth memory system with distributed request broadcasting masters

A system, comprising:

• a plurality of memory units, wherein at least one of the plurality of memory units is configured to decompose a broadcasted compressed memory request into a corresponding plurality of partial requests;
• and
• a processor coupled to each of the plurality of memory units by a plurality of network connections, wherein the processor includes a plurality of processing elements arranged in a two-dimensional array and a corresponding two-dimensional communication network communicatively connecting each of the plurality of processing elements to other processing elements on same axes of the two-dimensional array, and wherein each processing element of the plurality of processing elements located along a diagonal of the two-dimensional array is configured as a request broadcasting master for a respective group of processing elements of the plurality of processing elements located along a same axis of the two-dimensional array.