US 2026/0037594 A1Published application

Dimension control in tensor matrix multiplication

AssigneeInternational Business Machines Corporation

InventorsCedric Lichtenau, Simon Bubeck, Preetham M. Lobo, Dan Greiner

Life of this patent

Estimating the term…

Loading patent…

Abstract

Dimension control in tensor multiplication includes obtaining first and second input tensors for matrix multiplication, obtaining a dimension control indicator that indicates a first dimension for the first input tensor to use as a common dimension for the matrix multiplication and indicates a second dimension for the second input tensor to use as the common dimension for the matrix multiplication, and performing the matrix multiplication to obtain one or more results, where performing the matrix multiplication includes selecting at least one vector of the first input tensor based on the first dimension indicated by the dimension control indicator and selecting at least one vector of the second input tensor based on the second dimension indicated by the dimension control indicator.

Claims25

Dependent claims

A computer program product comprising:

a set of one or more computer-readable storage media;
program instructions, collectively stored in the set of one or more computer-readable storage media, for causing at least one computing device to perform computer operations including:
executing an instruction, the executing the instruction including:
obtaining a first input tensor and a second input tensor for matrix multiplication of the first input tensor and the second input tensor;
obtaining a dimension control indicator, the dimension control indicator indicating a first dimension for the first input tensor to use as a common dimension for the matrix multiplication and indicating a second dimension for the second input tensor to use as the common dimension for the matrix multiplication;
and
performing the matrix multiplication to obtain one or more results, wherein the performing the matrix multiplication includes selecting at least one vector of the first input tensor based on the first dimension indicated by the dimension control indicator and selecting at least one vector of the second input tensor based on the second dimension indicated by the dimension control indicator.

4 more elements

A computer system comprising:

at least one computing device;
a set of one or more computer-readable storage media;
and
program instructions, collectively stored in the set of one or more computer-readable storage media, for causing the at least one computing device to perform computer operations including:
executing an instruction, the executing the instruction including:
obtaining a first input tensor and a second input tensor for matrix multiplication of the first input tensor and the second input tensor;
obtaining a dimension control indicator, the dimension control indicator indicating a first dimension for the first input tensor to use as a common dimension for the matrix multiplication and indicating a second dimension for the second input tensor to use as the common dimension for the matrix multiplication;
and
performing the matrix multiplication to obtain one or more results, wherein the performing the matrix multiplication includes selecting at least one vector of the first input tensor based on the first dimension indicated by the dimension control indicator and selecting at least one vector of the second input tensor based on the second dimension indicated by the dimension control indicator.

6 more elements

A computer system comprising:

at least one hardware accelerator to be used in executing an instruction, the executing the instruction including:
obtaining a first input tensor and a second input tensor for matrix multiplication of the first input tensor and the second input tensor;
obtaining a dimension control indicator, the dimension control indicator indicating a first dimension for the first input tensor to use as a common dimension for the matrix multiplication and indicating a second dimension for the second input tensor to use as the common dimension for the matrix multiplication, wherein the dimension control indicator includes a first control indicator that indicates the first dimension and a second control indicator that indicates the second dimension, and wherein obtaining the dimension control indicator obtains the dimension control indicator from a parameter block specified by the instruction;
and
performing the matrix multiplication to obtain one or more results, wherein the performing the matrix multiplication includes selecting at least one vector of the first input tensor based on the first dimension indicated by the dimension control indicator and selecting at least one vector of the second input tensor based on the second dimension indicated by the dimension control indicator, and wherein the performing the matrix multiplication further includes:
selecting a first vector from one or more vectors of the first input tensor based on the indicated first dimension for the first input tensor, and selecting a second vector from one or more vectors of the second input tensor based on the indicated second dimension for the second input tensor;
and
determining a dot product of the first vector and the second vector to obtain a value, wherein the value is an intermediate value of an element to be provided in an output tensor;
performing an operation using the intermediate value of the element to be provided in the output tensor and an element of a third input tensor to provide a resulting value of the element to be provided in the output tensor;
and
repeating the selecting, the determining, and the performing an operation to obtain one or more resulting values of elements to be provided in the output tensor.

8 more elements

A computer-implemented method comprising:

executing an instruction, the executing the instruction including:
obtaining a first input tensor and a second input tensor for matrix multiplication of the first input tensor and the second input tensor;
obtaining a dimension control indicator, the dimension control indicator indicating a first dimension for the first input tensor to use as a common dimension for the matrix multiplication and indicating a second dimension for the second input tensor to use as the common dimension for the matrix multiplication, wherein the dimension control indicator includes a first control indicator that indicates the first dimension and a second control indicator that indicates the second dimension, and wherein obtaining the dimension control indicator obtains the dimension control indicator from a parameter block specified by the instruction;
and
performing the matrix multiplication to obtain one or more results, wherein the performing the matrix multiplication includes selecting at least one vector of the first input tensor based on the first dimension indicated by the dimension control indicator and selecting at least one vector of the second input tensor based on the second dimension indicated by the dimension control indicator, and wherein the performing the matrix multiplication further includes:
selecting a first vector from one or more vectors of the first input tensor based on the indicated first dimension for the first input tensor, and selecting a second vector from one or more vectors of the second input tensor based on the indicated second dimension for the second input tensor;
and
determining a dot product of the first vector and the second vector to obtain a value, wherein the value is an intermediate value of an element to be provided in an output tensor;
and
performing an operation using the intermediate value of the element to be provided in the output tensor and an element of a third input tensor to provide a resulting value of the element to be provided in the output tensor;
and
repeating the selecting, the determining, and the performing an operation to obtain one or more resulting values of elements to be provided in the output tensor.

9 more elements

Dependencies are inferred from the claim text.