Implementing Matrix Multiplication on a Systolic Array with Reconfigurable Processing Elements

A compiler tool for selecting between executing a matrix multiplication operation in a weight stationary mode or in an output stationary mode on a systolic array with reconfigurable processing elements, wherein the matrix multiplication operation comprises a multiplication of a first matrix with a second matrix to determine a result matrix, and wherein the compiler tool is configured to:

• receive configuration parameters of the systolic array;
• receive energy parameters related to executing predetermined operations on the systolic array;
• receive performance parameters related to executing the predetermined operations on the systolic array;
• receive first dimensions of the first matrix and second dimensions of the second matrix;
• estimate a first energy consumption of executing the matrix multiplication operation on the systolic array in the weight stationary mode based on the energy parameters, the configuration parameters, and the first and second dimensions;
• estimate a first performance number of executing the matrix multiplication operation on the systolic array in the weight stationary mode based on the performance parameters, the configuration parameters, and the first and second dimensions;
• estimate a second energy consumption of executing the matrix multiplication operation on the systolic array in the output stationary mode based on the energy parameters, the configuration parameters, and the first and second dimensions;
• estimate a second performance number of executing the matrix multiplication operation on the systolic array in the output stationary mode based on the performance parameters, the configuration parameters, and the first and second dimensions;
• and
• select between executing the matrix multiplication operation on the systolic array in the weight stationary mode and in the output stationary mode based on the first and second energy consumption and the first and second performance numbers.

A non-transitory computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to operate a compiler tool for selecting between executing a matrix multiplication operation in a weight stationary mode or in an output stationary mode on a systolic array with reconfigurable processing elements, wherein the matrix multiplication operation comprises a multiplication of a first matrix with a second matrix to determine a result matrix, the instructions comprising:

• receiving configuration parameters of the systolic array;
• receiving energy parameters related to executing predetermined operations on the systolic array;
• receiving performance parameters related to executing the predetermined operations on the systolic array;
• receiving first dimensions of the first matrix and second dimensions of the second matrix;
• estimating a first energy consumption of executing the matrix multiplication operation on the systolic array in the weight stationary mode based on the energy parameters, the configuration parameters, and the first and second dimensions;
• estimating a first performance number of executing the matrix multiplication operation on the systolic array in the weight stationary mode based on the performance parameters, the configuration parameters, and the first and second dimensions;
• estimating a second energy consumption of executing the matrix multiplication operation on the systolic array in the output stationary mode based on the energy parameters, the configuration parameters, and the first and second dimensions;
• estimating a second performance number of executing the matrix multiplication operation on the systolic array in the output stationary mode based on the performance parameters, the configuration parameters, and the first and second dimensions;
• and
• selecting between executing the matrix multiplication operation on the systolic array in the weight stationary mode and in the output stationary mode based on the first and second energy consumption and the first and second performance numbers.