Machine learning sparse computation mechanism
AssigneeIntel Corporation
InventorsEriko Nurvitadhi, Balaji Vembu, Tsung-Han Lin, Kamal Sinha, Rajkishore Barik, Nicolas C. Galoppo Von Borries
Life of this patent
Estimating the term…
Abstract
An apparatus to facilitate processing of a sparse matrix is disclosed. The apparatus includes a plurality of processing units each comprising one or more processing elements, including logic to read operands, a multiplication unit to multiply two or more operands and a scheduler to identify operands having a zero value and prevent scheduling of the operands having the zero value at the multiplication unit.
Claims19
An apparatus to facilitate processing a sparse matrix, comprising:
- a graphics processing unit, including:
- a plurality of processing units each comprising one or more processing elements to perform neural network matrix multiplication operations, including:
- pattern tracking logic to detect one or more segments of sparse data in a stored block of matrix data;
- logic to read operands;
- a multiplication unit to multiply two or more operands;
- and
- a scheduler to identify operands having a zero value and prevent scheduling of the operands having the zero value at the multiplication unit.
(canceled)
14-16. (canceled)
A graphics processing unit comprising:
- a plurality of processing units each comprising one or more processing elements to perform neural network matrix multiplication operations, including:
- pattern recognition logic to detect one or more segments of sparse data in a stored block of data;
- compression logic to generate a compressed sparse matrix of sparse data upon a determination that the segment of sparse data meets a sparsity predetermined threshold;
- and
- a storage device to store the compressed sparse matrix.
Dependencies are inferred from the claim text.