Analog MAC aware DNN improvement
AssigneeMicrosoft Technology Licensing, LLC
InventorsGilad Kirshenboim, Ran Sahar, Douglas C. Burger, Yehonathan Refael Kalim
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsGilad Kirshenboim, Ran Sahar, Douglas C. Burger, Yehonathan Refael Kalim
Estimating the term…
Methods, systems and computer program products are provided for improving performance (e.g., reducing power consumption) of a hardware accelerator (e.g., neural processor) comprising hybrid or analog multiply and accumulate (MAC) processing elements (PEs). Selective variation of the precision of an array of MAC PEs may reduce power consumption of a neural processor. Power may be conserved by dynamically controlling the precision of analog to digital (ADC) output bits for one or more MAC PEs. Dynamic control of ADC output bit precision may be based on precision information determined during training and/or post-training (e.g., quantization) of an artificial intelligence (AI) neural network (NN) model implemented by the neural processor. Precision information may include a range of dynamic precision for each of a plurality of nodes of a computation graph for the AI NN model.
A neural processing unit (NPU), comprising:
A neural processing unit (NPU) configured to implement a neural network (NN) model, the NPU comprising:
A method in a neural processing unit (NPU), the method comprising:
Dependencies are inferred from the claim text.