Low latency matrix multiply unit

A method comprising:

• receiving, by a weight matrix register of a cell of a plurality of cells arranged in an array of a matrix multiply unit, a weight input from a plurality of weight storing registers, wherein each of the plurality of weight storing registers is configured to receive a respective weight input from a respective direction of the array, wherein the respective directions comprise a first direction of the array and a second direction of the array different from the first direction;
• and
• obtaining, by a multiply unit that is coupled to the weight matrix register, a multiplication result based on the received weight input and another input data.

A non-transitory computer program product storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:

• receiving, by a weight matrix register of a cell of a plurality of cells arranged in an array of a matrix multiply unit, a weight input from a plurality of weight storing registers, wherein each of the plurality of weight storing registers is configured to receive a respective weight input from a respective direction of the array, wherein respective directions comprise a first direction of the array and a second direction of the array different from the first direction;
• and
• obtaining, by a multiply unit that is coupled to the weight matrix register, a multiplication result based on the received weight input and another input data.