Data transfers between a memory and a distributed compute array

A controller disposed within an integrated circuit having a plurality of dies, the controller comprising:

• a request controller configured to convert first requests for access to a memory into second requests compliant with an on-chip communication bus, wherein the request controller provides the second requests to a plurality of request buffer-bus master circuit blocks configured to receive data from a plurality of channels of the memory;
• a remote buffer read address generation unit coupled to the request controller and configured to monitor a fill level in each of a plurality of remote buffers distributed across the plurality of dies, wherein each remote buffer of the plurality of remote buffers is configured to provide data obtained from respective ones of the plurality of request buffer-bus master circuit blocks to a compute array also distributed across the plurality of dies;
• and
• wherein, in response to determining that each remote buffer of the plurality of remote buffers is storing data based on the fill level, the remote buffer read address generation unit is configured to initiate a data transfer from each remote buffer of the plurality of remote buffers to the compute array across the plurality of dies.

A method, comprising:

• monitoring a fill level in a plurality of remote buffers distributed across the plurality of dies, wherein each remote buffer of the plurality of remote buffers is configured to provide data to a compute array also distributed across the plurality of dies;
• determining that each remote buffer of the plurality of remote buffers is storing data based on the fill level;
• and
• in response to the determining, initiating a data transfer from each remote buffer of the plurality of remote buffers to the compute array across the plurality of dies.