Back to results
US 2024/0256633 A1Published application
Application programming interface to accelerate matrix operations
AssigneeNVIDIA Corporation
InventorsPiotr Majcher, Mostafa Hagog, Philippe Vandermersch
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to determine a matrix multiplication algorithm for a matrix multiplication operation. In at least one embodiment, a matrix multiplication operation is analyzed to determine an appropriate matrix multiplication algorithm to perform the matrix multiplication algorithm.
Claims20
An acceleration processor unit (APU) comprising:
- one or more core complexes, wherein the one or more core complexes include one or more central processing unit (CPU) cores;
- one or more graphics complexes, wherein the one or more graphics complexes include one or more compute units and include at least one L2 cache;
- one or more fabric interconnects;
- one or more memory controllers;
- one or more input/output (I/O) bus interfaces, at least one comprising a peripheral component interconnect express (PCIe) interface;
- wherein the APU is utilized to implement an application programming interface (API) call to select one or more general matrix-to-multiple (GEMM) implementations from among a plurality of GEMM implementations;
- wherein the API call is to use:
- input matrices;
- a matrix multiply operation descriptor;
- a matrix layout descriptor;
- a search preferences parameter
- an algorithm count parameter to specify a number of algorithms desired;
- a results array parameter;
- a results count parameter to store a number of algorithms returned;
- and
- an operation status to indicate whether the API call is successful or if other errors have occurred.
13 more elements
A method comprising:
- implementing an application programming interface (API) call to select one or more general matrix-to-multiple (GEMM) implementations from among a plurality of GEMM implementations, wherein the API call is to use:
- input matrices;
- a matrix multiply operation descriptor;
- a matrix layout descriptor;
- a search preferences parameter
- an algorithm count parameter to specify a number of algorithms desired;
- a results array parameter;
- a results count parameter to store a number of algorithms returned;
- and
- an operation status to indicate whether the API call is successful or if other errors have occurred;
- and
- the API call is to be implemented by a processor comprising:
- one or more core complexes, wherein the one or more core complexes include one or more central processing unit (CPU) cores;
- one or more graphics complexes, wherein the one or more graphics complexes include one or more compute units and include at least one L2 cache;
- one or more fabric interconnects;
- one or more memory controllers;
- one or more input/output (I/O) bus interfaces, at least one comprising a peripheral component interconnect express (PCIe) interface.
14 more elements
A system comprising:
- memory;
- and
- an acceleration processor unit (APU) comprising:
- one or more core complexes, wherein the one or more core complexes include one or more central processing unit (CPU) cores;
- one or more graphics complexes, wherein the one or more graphics complexes include one or more compute units and include at least one L2 cache;
- one or more fabric interconnects;
- one or more memory controllers;
- one or more input/output (I/O) bus interfaces, at least one comprising a peripheral component interconnect express (PCIe) interface;
- wherein the APU is utilized to implement an application programming interface (API) call to select one or more general matrix-to-multiple (GEMM) implementations from among a plurality of GEMM implementations;
- wherein the API call is to use:
- input matrices;
- a matrix multiply operation descriptor;
- a matrix layout descriptor;
- a search preferences parameter
- an algorithm count parameter to specify a number of algorithms desired;
- a results array parameter;
- a results count parameter to store a number of algorithms returned;
- and
- an operation status to indicate whether the API call is successful or if other errors have occurred.
16 more elements
Dependencies are inferred from the claim text.