Apparatus and methods for matrix multiplication

A method for matrix multiplication in a neural network, comprising:

• receiving, by a controller unit, a matrix-multiply-matrix (MM) instruction that includes a first starting address of a first matrix, a first size of the first matrix, a second starting address of a second matrix, and a second size of the second matrix;
• receiving, by multiple computation modules, the first matrix based the first starting address and the first size of the first matrix;
• receiving, by the multiple computation modules, the second matrix based on the second starting address and the second size of the second matrix;
• respectively multiplying, in response to the MM instruction by the multiple computation modules, row vectors of the first matrix with column vectors of the second matrix to generate one or more result elements;
• combining, by an interconnection unit, the result elements to generate one or more row vectors of a result matrix;
• and
• combining, by at least one of the multiple computation modules, the row vectors to generate the result matrix.