Compute optimizations for neural networks

A method comprising:

• decoding a single instruction specifying multiple operands, the multiple operands including a multi-bit input value and a one-bit weight associated with a neural network;
• issuing the single instruction for execution within a compute unit of a general-purpose graphics processing unit;
• and
• responsive to the execution of the single instruction, generating a result by performing a multiplication operation on the multi-bit input value based on the one-bit weight to generate an intermediate product and updating a value stored in an accumulator register by adding the intermediate product to the value stored in the accumulator register, the multiplication operation comprising a fused operation including an exclusive not OR (XNOR) operation and a population count operation.

A data processing system comprising:

• a general-purpose graphics processing unit comprising:
• a decode unit to decode a single instruction into a decoded instruction that specifies multiple operands including a multi-bit input value and a one-bit weight associated with a neural network, and
• an arithmetic logic unit including a multiplier, an adder, and an accumulator register, wherein to execute the decoded instruction, the multiplier is to perform a multiplication operation on the multi-bit input value based on the one-bit weight to generate an intermediate product, the adder is to add the intermediate product to a value stored in the accumulator register and update the value stored in the accumulator register, and the multiplication operation comprises a fused operation including an exclusive not OR (XNOR) operation and a population count operation;
• and
• a memory coupled with the general-purpose graphics processing unit.