MxN systolic array and processing system that inputs weights to rows or columns based on mode to increase utilization of processing elements
AssigneeSK hynix Inc.
InventorJi-Hoon Nam
Life of this patent
Estimating the term…
Abstract
A processing system may include a systolic array including a plurality of processing elements (PEs) arrayed in M rows and N columns, where M and N are natural numbers and M is not equal to N. The processing system may further include a row buffer configured to transmit row data to the systolic array in a row direction, and a column buffer configured to transmit column data to the systolic array in a column direction. When the processing system is in a first mode, the row data is input data and the columns data is weights. When the processing system is in a second mode the row data is the weights and the column data is the input data.
Claims13
A processing system comprising:
- a systolic array comprising a plurality of processing elements (PEs) arrayed in M rows and N columns, wherein M and N are natural numbers and M is not equal to N;
- a row buffer configured to transmit row data to the systolic array in a row direction, wherein the row data is input data in response to the processing system being in a first mode when performing an operation and the row data is weights in response to the processing system being in a second mode when performing the operation;
- and
- a column buffer configured to transmit column data to the systolic array in a column direction, wherein the column data is the weights in response to the processing system being in the first mode when performing the operation and the column data is the input data in response to the processing system being in the second mode when performing the operation.
A systolic array, comprising:
- M row inputs configured to transmit input data as row data in response to a first mode being set when performing an operation and to transmit weights as the row data in response to a second mode being set when performing the operation, wherein M is a natural number;
- N column inputs configured to transmit the weights as column data in response to the first mode being set when performing the operation and to transmit the input data as the column data in response to the second mode being set when performing the operation, wherein N is a natural number and N is not equal to M;
- and
- M*N processing elements (PEs) each configured to perform a multiplication operation on row data transmitted to a row input corresponding to the PE among the M row inputs and column data transmitted to a column input corresponding to the PE among the N column inputs, and to sum a result of the multiplication operation and a result of a previous operation.
Dependencies are inferred from the claim text.