Neural network accelerator performing operation with mixed-format weights
AssigneeIntel Corporation
InventorsArnab Raha, Michael Wu, Deepak Abraham Mathaikutty, Daksha Sharma, Martin Langhammer
Life of this patent
Estimating the term…
Loading patent…
AssigneeIntel Corporation
InventorsArnab Raha, Michael Wu, Deepak Abraham Mathaikutty, Daksha Sharma, Martin Langhammer
Estimating the term…
A data processing unit may include a memory, processing elements (PEs), and a control unit. The memory may store weight blocks within a weight tensor of a neural network operation. Each weight block has an input channel (IC) dimension and an output channel (OC) dimension and includes subblocks. A subblock includes one or more weights having a first data precision and one or more other weights having a second data precision. The second data precision is lower than the first data precision. The control unit may distribute different ones of the subblocks to different ones of the PEs. A PE may receive a subblock and perform a first MAC operation on a weight having a first data precision and a second MAC operation on a weight having a second data precision. The first MAC operation may consume more computation cycles or more multipliers than the second MAC operation.
An apparatus, comprising:
A method of executing a neural network, the method comprising:
One or more non-transitory computer-readable media storing instructions executable to perform operations for executing a neural network, the operations comprising:
Dependencies are inferred from the claim text.