US 2024/0256631 A1Published application

Matrix summation using integrated matrices

AssigneeSambaNova Systems, Inc.

InventorsPramod NATARAJA, Raghu PRABHAKAR, David Brian JACKSON, Ram SIVARAMAKRISHNAN

Life of this patent

Estimating the term…

Loading patent…

Abstract

A computing method comprises combining an M×K multiplicand matrix and P number of addend vectors to generate an M×(K+P) integrated matrix. The addend vectors can comprise a vector of constants and/or a column of an addend matrix. The method further comprises generating a row-extended matrix comprising a K×N multiplicand matrix and P rows of a constant vector. The method computes (K+P) products of a row of the integrated matrix multiplied by a column of the row-extended matrix and computing an integrated sum of the products. A multiply-accumulate computation can compute the integrated sum and is equivalent to a sum of K number of products of a column of the M×K matrix multiplied by a row of the K×N multiplicand matrix and added to the P number of addend vectors. A computing system can implement the method and can include a matrix computation unit.

Claims20

Dependent claims

A method, the method comprising:

generating, by a computing system, an Integrated Summation (ISUM) integrated matrix comprising number K of multiplicand columns and number P of addend columns, wherein each of columns 1 though the number K of multiplicand columns comprises respective columns 1 through the number K of a first multiplicand matrix having the number K of columns, and wherein each of the number P of addend columns comprises an integrated addend;
generating, by the computing system, an ISUM row-extended matrix comprising the number K of multiplicand rows and the number P of extended rows, wherein rows 1 through the number K of the multiplicand rows comprise respective rows 1 though the number K of a second multiplicand matrix having the number K of rows, and wherein each extended row, among the number P of extended rows, comprises a constant row;
computing, by the computing system, (K+P) number of products, the (K+P) number of products comprising each column element of columns 1 through (K+P) of a row of the ISUM integrated matrix, multiplied by a corresponding row element, among rows 1 through (K+P), of a column of the ISUM row-extended matrix;
and,
computing, by the computing system, an Integrated Sum comprising a sum of the (K+P) number of products.

2 more elements

A computer program product, the computer program product comprising a computer readable storage medium having first program instructions embodied therewith, wherein the first program instructions are executable by at least one processor to cause the at least one processor to:

generate an Integrated Summation (ISUM) integrated matrix comprising number K of multiplicand columns and number P of addend columns, wherein each of columns 1 though the number K of multiplicand columns comprises respective columns 1 through the number K of a first multiplicand matrix having the number K of columns, and wherein each of the number P of addend columns comprises an integrated addend;
generate an ISUM row-extended matrix comprising the number K of multiplicand rows and the number P of extended rows, wherein rows 1 through the number K of the multiplicand rows comprise respective rows 1 though the number K of a second multiplicand matrix having the number K of rows, and wherein each extended row, among the number P of extended rows, comprises a constant row;
compute a (K+P) number of products, the (K+P) number of products comprising each column element of columns 1 through (K+P) of a row of the ISUM integrated matrix, multiplied by a corresponding row element, among rows 1 through (K+P), of a column of the ISUM row-extended matrix;
and,
compute an Integrated Sum comprising a sum of the (K+P) number of products.

2 more elements

A computing system, the computing system comprising an ISUM Integrated Summation (ISUM) matrix integrator and an ISUM processing unit (ISUM PU),

wherein the ISUM matrix integrator is configured to:
generate an ISUM integrated matrix comprising number K of multiplicand columns and number P of addend columns, wherein each of columns 1 though the number K of multiplicand columns comprises respective columns 1 through the number K of a first multiplicand matrix having the number K of columns, and wherein each of the number P of addend columns comprises an integrated addend;
and,
generate an ISUM row-extended matrix comprising the number K of multiplicand rows and the number P of extended rows, wherein rows 1 through the number K of the multiplicand rows comprise respective rows 1 though the number K of a second multiplicand matrix having the number K of rows, and wherein each extended row, among the number P of extended rows, comprises a constant row;
and,
wherein the ISUM PU is configured to:
compute (K+P) number of products, the (K+P) number of products comprising each column element of columns 1 through (K+P) of a row of the ISUM integrated matrix, multiplied by a corresponding row element, among rows 1 through (K+P), of a column of the ISUM row-extended matrix;
and,
compute an Integrated Sum comprising a sum of the (K+P) number of products.

6 more elements

Dependencies are inferred from the claim text.