Utilizing structured sparsity in systolic arrays

At least one non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one processor to at least:

• receiving, by a systolic array of the at least one processor, data from a plurality of source registers, the data comprising unpacked source data, structured source data that is packed based on sparsity, and metadata corresponding to the structured source data;
• identifying portions of the unpacked source data to multiply with the structured source data, the portions of the unpacked source data identified based on the metadata;
• and
• outputting, to a destination register, a result of multiplication of the portions of the unpacked source data and the structured source data.

A method comprising:

• receiving, by a systolic array of a processing device, data from a plurality of source registers of the processing device, the data comprising unpacked source data, structured source data that is packed based on sparsity, and metadata corresponding to the structured source data;
• identifying portions of the unpacked source data to multiply with the structured source data, the portions of the unpacked source data identified based on the metadata;
• and
• outputting, to a destination register of the processing device, a result of multiplication of the portions of the unpacked source data and the structured source data.