Non-rectangular matrix computations and data pattern processing using tensor cores

A computer-implemented method for performing a matrix multiplication operation, the method comprising:

• partitioning, by a host processor, an output operand of the matrix multiplication operation into a number of tiles;
• responsive to determining that the output operand of the matrix multiplication operation is a square matrix having a triangular data pattern:
• for at least one tile of the output operand:
• determining whether the at least one tile is valid based on a location of the tile relative to a main diagonal of the square matrix, and
• responsive to determining that the at least one tile is valid, launching an operation on a parallel processing unit to generate values for the elements of the at least one tile using a at least one tensor core, or
• responsive to determining that the at least one tile is invalid, preventing the elements of the at least one tile from being processed by the parallel processing unit;
• or
• responsive to determining that an input operand of the matrix multiplication operation is a square matrix having a triangular data pattern:
• for at least one tile of the output operand:
• partitioning a portion of the input operand into a number of sub-tiles associated with the at least one tile of the output operand,
• for at least one sub-tile of the input operand, determining whether the at least one sub-tile is valid based on a location of the at least one sub-tile relative to a main diagonal of the square matrix, and
• responsive to determining that the at least one sub-tile is valid, launching an operation on the parallel processing unit to generate values for the elements of the at least one tile using the at least one tensor core to process the elements of the at least one sub-tile, or
• responsive to determining that the at least one sub-tile is invalid,
• preventing the elements of the at least one sub-tile from being processed by the parallel processing unit.

A non-transitory computer-readable media storing computer instructions for performing a matrix multiplication operation that, when executed by a host processor, cause the host processor to perform the steps of:

• partitioning, by a host processor, an output operand of the matrix multiplication operation into a number of tiles;
• responsive to determining that the output operand of the matrix multiplication operation is a square matrix having a triangular data pattern:
• for at least one tile of the output operand:
• determining whether the at least one tile is valid based on a location of the at least one tile relative to a main diagonal of the square matrix, and
• responsive to determining that the at least one tile is valid, launching an operation on the parallel processing unit to generate values for the elements of the at least one tile using the at least one tensor core, or
• responsive to determining that the at least one tile is invalid, preventing the elements of the at least one tile from being processed by the parallel processing unit;
• or
• responsive to determining that an input operand of the matrix multiplication operation is a square matrix having a triangular data pattern:
• for at least one tile of the output operand:
• partitioning a portion of the input operand into a number of sub-tiles associated with the at least one tile of the output operand,
• for at least one sub-tile of the input operand, determining whether the at least one sub-tile is valid based on a location of the at least one sub-tile relative to a main diagonal of the square matrix, and
• responsive to determining that the at least one sub-tile is valid, launching an operation on a parallel processing unit to generate values for the elements of the at least one tile using at least one tensor core to process the elements of the at least one sub-tile, or
• responsive to determining that the at least one sub-tile is invalid, preventing the elements of the at least one sub-tile from being processed by the parallel processing unit.