Systolic array-friendly data placement and control

A method for systolic array-friendly data placement, comprising:

• receiving, by a systolic array, staged input data,
• performing an operation using the staged input data, thereby generating a first output matrix and a second output matrix;
• generating a pattern generation signal;
• generating a mask based on the pattern generation signal;
• and
• storing merged output data comprising the first output matrix and the second output matrix.

A non-transitory computer readable storage medium storing a set of instructions that are executable by at least one processor of a computing device to cause the computing device to perform a method for executing a convolutional neural network operation, the method comprising:

• fetching one or more batches of data in a first memory;
• regrouping the one or more batches of data into multiple work items, wherein a first work item partially overlaps one or more work items among the multiple work items;
• and
• broadcasting the multiple work items to a processing array comprising a plurality of processing strings, wherein the first work item is transferred to two or more processing strings of the processing array.