Integrator voltage shifting for improved performance in softmax operation

A method for saturation prevention of a current integrator in a Resistive Processing Unit-based (RPU-based) accelerator, comprising:

• reducing, by a voltage generator operatively coupled between an input terminal and an output terminal of the current integrator, a magnitude of an output voltage at the output terminal of the current integrator during a current integration operation by selectively applying a non-zero initial voltage to the current integrator prior to the current integration operation, responsive to an operating state of the set of hardware switches.

An apparatus for saturation prevention of a current integrator in a Resistive Processing Unit-based (RPU-based) accelerator, comprising:

• a saturation detector for detecting an impending saturation condition of an output of the current integrator;
• a current source trigger signal generator for generating a trigger signal responsive to a detection of the impending saturation condition;
• a current source for reducing a magnitude of an existing current at the input terminal of the current integrator during a current integration operation by generating a current of opposing polarity to the existing current at the input terminal to prevent an occurrence of the saturation condition, responsive to the trigger signal.