Methods and systems for selecting quantisation parameters for deep neural networks using back-propagation
AssigneeImagination Technologies Limited
InventorSzabolcs Csefalvay
Life of this patent
Estimating the term…
Loading patent…
AssigneeImagination Technologies Limited
InventorSzabolcs Csefalvay
Estimating the term…
Methods and systems for identifying quantisation parameters for a Deep Neural Network (DNN). The method includes determining an output of a model of the DNN in response to training data, the model of the DNN comprising one or more quantisation blocks configured to transform a set of values input to a layer of the DNN prior to processing the set of values in accordance with the layer, the transformation of the set of values simulating quantisation of the set of values to a fixed point number format defined by one or more quantisation parameters; determining a cost metric of the DNN based on the determined output and a size of the DNN based on the quantisation parameters; back-propagating a derivative of the cost metric to one or more of the quantisation parameters to generate a gradient of the cost metric for each of the one or more quantisation parameters; and adjusting one or more of the quantisation parameters based on the gradients.
A computer-implemented method to configure hardware to implement a Deep Neural Network (DNN), the method comprising, in at least one processor:
A computing-based device to configure hardware to implement a Deep Neural Network (DNN), the computing-based device comprising:
Dependencies are inferred from the claim text.