Back to results
US 11,960,567 B2Granted
Implementing fundamental computational primitives using a matrix multiplication accelerator (MMA)
AssigneeTexas Instruments Incorporated
InventorsArthur John Redfern, Timothy David Anderson, Kai Chirca, Chenchi Luo, Zhenhua Yu
Life of this patent
Estimating the term…
Abstract
A method for performing a fundamental computational primitive in a device is provided, where the device includes a processor and a matrix multiplication accelerator (MMA). The method includes configuring a streaming engine in the device to stream data for the fundamental computational primitive from memory, configuring the MMA to format the data, and executing the fundamental computational primitive by the device.
Claims20
A matrix multiplication accelerator comprising:
- a first formatting component having a first input and a first output;
- a second formatting component having a second input and second output;
- a third formatting component having a third input and a third output;
- a row offset component having an offset input coupled to the second output, and an offset output;
- a first memory having a first matrix input coupled to the first output, and a first matrix output;
- a second memory having a second matrix input coupled to the offset output, and a second matrix output;
- a nonlinearity component having a nonlinearity input, and a nonlinearity output coupled to the third input;
- a third memory having a third matrix input, and a third matrix output coupled to the nonlinearity input;
- and
- a matrix multiplication component coupled to the first matrix output, the second matrix output, and the third matrix input.
7 more elements
A matrix multiplication accelerator, comprising:
- a first formatting component having a first input and a first output;
- a second formatting component having a second input and second output;
- a third formatting component having a third input and a third output;
- a row offset component having an offset input coupled to the second output, and an offset output;
- a first memory having a first matrix input coupled to the first output, and a first matrix output;
- a second memory having a second matrix input coupled to the offset output, and a second matrix output;
- a nonlinearity component having a nonlinearity input, and a nonlinearity output coupled to the third input;
- a third memory having a third matrix input, and a third matrix output coupled to the nonlinearity input;
- and
- a matrix multiplication component coupled to the first matrix output, the second matrix output, and the third matrix input;
- wherein the first formatting component, the second formatting component, the third formatting component, the row offset component, and the nonlinearity component each include a configuration input;
- and
- wherein the first formatting component, the second formatting component, the third formatting component, the row offset component, and the nonlinearity component are each configured based on a configuration setting received on the configuration input corresponding to a computational primitive.
10 more elements
Dependencies are inferred from the claim text.