Back to results
US 2021/0334337 A1Published application
Implementing Fundamental Computational Primitives Using A Matrix Multiplication Accelerator (MMA)
AssigneeTexas Instruments Incorporated
InventorsArthur John Redfern, Timothy David Anderson, Kai Chirca, Chenchi Luo, Zhenhua Yu
Life of this patent
Estimating the term…
Abstract
A method for performing a fundamental computational primitive in a device is provided, where the device includes a processor and a matrix multiplication accelerator (MMA). The method includes configuring a streaming engine in the device to stream data for the fundamental computational primitive from memory, configuring the MMA to format the data, and executing the fundamental computational primitive by the device.
Claims20
A matrix multiplication accelerator comprising:
- a first formatting component having a first input and a first output;
- a second formatting component having a second input and second output;
- a third formatting component having a third input and a third output;
- a row offset component having an offset input coupled to the second output, and an offset output;
- a first memory having a first matrix input coupled to the first output, and a first matrix output;
- a second memory having a second matrix input coupled to the offset output, and a second matrix output;
- a nonlinearity component having a nonlinearity input, and a nonlinearity output coupled to the third input;
- a third memory having a third matrix input, and a third matrix output coupled to the nonlinearity input;
- and
- a matrix multiplication component coupled to the first matrix output, the second matrix output, and the third matrix input.
7 more elements
A method comprising:
- configuring, by a processor, a matrix multiplication accelerator (MMA) based on a computational primitive;
- and
- executing, by the MMA, the computational primitive to produce an MMA output.
Dependencies are inferred from the claim text.