Sparse convolutional neural network accelerator

A convolutional neural network accelerator, comprising:

• an array of processing elements, each processing element comprising a multiplier array that is configured to:
• receive a first vector comprising only non-zero weight values and first associated positions of the non-zero weight values within a first space;
• receive a second vector comprising only non-zero input activation values and second associated positions within a second space;
• multiply the non-zero weight values with the non-zero activation values to produce a third vector of products;
• combine the first associated positions with the second associated positions to produce a fourth vector of positions, wherein each position in the fourth vector is associated with a respective product in the third vector;
• and
• transmit the third vector to an accumulator array, wherein each one of the products in the third vector is transmitted to an adder in the accumulator array that is configured to generate an output activation value at the position associated with the product.

A system, comprising:

• a non-transitory memory storing vectors comprising only non-zero weight values and first associated positions of the non-zero weight values within a first space;
• and
• a convolutional neural network accelerator coupled to the memory and comprising:
• an array of processing elements, each processing element comprising a multiplier array that is configured to:
• receive, from the non-transitory memory, a first vector of the vectors;
• receive a second vector comprising only non-zero input activation values and second associated positions within a second space;
• multiply the non-zero weight values with the non-zero activation values to produce a third vector of products;
• combine the first associated positions with the second associated positions to produce a fourth vector of positions, wherein each position in the fourth vector is associated with a respective product in the third vector;
• and
• transmit the third vector to an accumulator array, wherein each one of the products in the third vector is transmitted to an adder in the accumulator array that is configured to generate an output activation value at the position associated with the product.