Online training of neural networks

A neural network comprising one or more layers of neuronal units, wherein each neuronal unit has an internal state, wherein the neural network is configured to perform a method for training a neural network, the method comprising

• providing training data comprising an input signal and an expected output signal to the neural network;
• computing, for each neuronal unit, a spatial gradient component;
• computing, for each neuronal unit, a temporal gradient component;
• and
• updating the temporal and the spatial gradient component for each neuronal unit at each time instance of the input signal.

A computer program product for training a recurrent neural network, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by the neural network to cause the neural network to perform a method comprising:

• receiving training data comprising an input signal and an expected output signal;
• computing, for each neuronal unit, a spatial gradient component;
• computing, for each neuronal unit, a temporal gradient component;
• and
• updating the temporal and the spatial gradient component for each neuronal unit at each time instance of the input signal.

A computing system configured to perform a computer-implemented method for training parameters of a neural network, the network comprising one or more layers of neuronal units, wherein each neuronal unit has an internal state, wherein the method comprises:

• providing training data comprising an input signal and an expected output signal to the neural network;
• computing, for each neuronal unit, a spatial gradient component;
• computing, for each neuronal unit, a temporal gradient component;
• and
• updating the temporal and the spatial gradient component for each neuronal unit at each time instance of the input signal.