Floorplan-optimized matrix extension architecture for processors
AssigneeAlibaba (China) Co., Ltd.
InventorsQichen ZHANG, Lide DUAN, Shengcheng WANG
Life of this patent
Estimating the term…
Abstract
Embodiments of the present disclosure includes a processor. The processor may include a systolic array of processing elements; a first group of buffers coupled to the systolic array, wherein the first group comprises one or more first buffers; a second group of buffers coupled to the systolic array, wherein the second group comprises one or more second buffers; an accumulator coupled to the systolic array; and a third group of buffers coupled to the accumulator, wherein the third group comprises one or more third buffers.
Claims20
A processor, comprising:
- a systolic array of processing elements;
- a first group of buffers coupled to the systolic array, wherein the first group comprises one or more first buffers;
- a second group of buffers coupled to the systolic array, wherein the second group comprises one or more second buffers;
- an accumulator coupled to the systolic array;
- and
- a third group of buffers coupled to the accumulator, wherein the third group comprises one or more third buffers.
A computing device, comprising a memory and a processor coupled to the memory, wherein the processor comprises:
- a systolic array of processing elements;
- a first group of buffers coupled to the systolic array, wherein the first group comprises one or more first buffers configured to pipeline first input data into the systolic array;
- a second group of buffers coupled to the systolic array, wherein the second group comprises one or more second buffers configured to broadcast weight data into the systolic array;
- an accumulator coupled to the systolic array and configured to receive output data from the systolic array;
- and
- a third group of buffers comprising one or more third buffers configured to transmit second input data to the accumulator via a first pathway of a data transmission loop and receive results from the accumulator via a second pathway of the data transmission loop.
A method, comprising:
- (1) storing, by a first group of buffers of a processor, at least one or more first elements of a first matrix, the first group of buffers comprising one or more first buffers;
- (2) storing, by a second group of buffers of the processor, at least one or more second elements of a second matrix, the second group of buffers comprising one or more second buffers;
- (3) obtaining, by a systolic array of the processor, the one or more first elements of the first matrix from the first group of buffers and the one or more second elements of the second matrix from the second group of buffers, the systolic array comprising processing elements coupled to the first group of buffers and the second group of buffers;
- (4) multiplying, by the systolic array, the one or more first elements with the one or more second to generate one or more intermediary values;
- (5) obtaining, by a third group of buffers of the processor, a third matrix;
- (6) obtaining, by an accumulator of the processor, one or more third elements of the third matrix from the third group of buffers and the one or more intermediary values from the systolic array;
- (7) adding, by the accumulator, the one or more third elements with the one or more intermediary values to obtain an intermediary sum;
- (8) transmitting, by the accumulator, the intermediary sum to the third group of buffers;
- (9) storing, by the third group of buffers, the intermediary sum as the one or more third elements of the third matrix;
- and
- (10) recursively performing, by the processor, steps (1)-(9) until a final result is stored to the third group of buffers, wherein the final result corresponds to a sum of the third matrix and a product between the first matrix and the second matrix.
Dependencies are inferred from the claim text.