A processing unit in memory for performing matrix-vector multiplication operations

A method comprising:

• receiving, at a processing unit of a memory device, a first column of a matrix of data values stored in a bank of the memory device, wherein the processing unit is coupled to the bank;
• receiving, at the processing unit, a vector of data values;
• storing the vector in a first plurality of registers;
• performing a first plurality of multiplication operations on a first data value of the vector utilizing a first plurality of data values of the column,
• wherein the first plurality of multiplication operations are performed by a plurality of multiply-accumulate (MAC) units, and
• wherein each of the first plurality of multiplication operations are performed by a different MAC unit of the plurality of MAC units;
• and
• receiving, at the processing unit, a second column of the matrix;
• performing a second plurality of multiplication operations on a second data value of the vector utilizing a second plurality of data values of the second column,
• wherein each of the second plurality of multiplication operations are performed by a different MAC unit of the plurality of MAC units;
• and
• storing an output of the first plurality of multiplication operations and the second plurality of multiplication operations in the bank.

An apparatus, comprising:

• a first bank of memory cells;
• a second bank of memory cells;
• a processing unit, comprising a plurality of multiply-accumulate (MAC) units, coupled to the first bank and the second bank;
• wherein the plurality of MAC units are configured to:
• receive a first plurality of data values of a first column of a matrix of data values stored in the first bank, wherein each MAC unit from the plurality of MAC units receives a different data value from the first plurality of data values of the first column;
• receive a first data value of a vector of data values stored in the second bank, wherein each MAC unit from the plurality of MAC units receives the first data value of the vector;
• perform a first plurality of multiplication operations on a first data value of the vector utilizing the first plurality of data values of the first column,
• wherein each of the first plurality of multiplication operations are performed by a different MAC unit of the plurality of MAC units;
• receive a second plurality of data values of a second column of the matrix stored in the first bank, wherein each MAC unit of the plurality of MAC units receives a different data value from the second plurality of data values of the second column;
• receive a second data value of the vector, wherein each MAC unit of the plurality of MAC units receives the second data value of the vector;
• perform a second plurality of multiplication operations utilizing the second data value of the vector and the second plurality of data values of the second column,
• wherein each of the second plurality of multiplication operations are performed by a different MAC unit of the plurality of MAC units;
• and
• store an output of the first plurality of multiplication operations and the second plurality of multiplication operations in the second bank.