Normalization in analog memory-based neural network
AssigneeInternational Business Machines Corporation
InventorsStefano Ambrogio, Andrea Fasoli
Life of this patent
Estimating the term…
Abstract
A scale factor can be determined and applied to input values of an analog neural network implemented by a crossbar array of non-volatile memory devices. An inverse of the scale factor can be applied to synaptic weight values stored by the crossbar array of non-volatile memory devices. Operations by the crossbar array can be performed using the scaled input values and the synaptic weight values. The scale factor can be determined for each row of the crossbar array. The scale factor can be determined using a combination of the input values and the synaptic weight values.
Claims20
A method comprising:
- determining a scale factor;
- applying the scale factor to input values of an analog neural network implemented by a crossbar array of non-volatile memory devices;
- and
- applying an inverse of the scale factor to synaptic weight values stored by the crossbar array of non-volatile memory devices.
An apparatus comprising:
- a crossbar array of non-volatile memory devices configured to perform multiply and accumulate operations based on synaptic weight values of a neural network stored on the non-volatile memory devices and input values received via rows of input lines coupled to the rows of the crossbar array;
- and
- a processor configured to apply a scale factor to the input values and to apply an inverse of the scale factor to the synaptic weight values stored by the crossbar array of non-volatile memory devices.
A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions readable by a device to cause the device to:
- determine a scale factor;
- apply the scale factor to input values of an analog neural network implemented by a crossbar array of non-volatile memory devices;
- and
- apply an inverse of the scale factor to weight values stored by the crossbar array of non-volatile memory devices.
Dependencies are inferred from the claim text.