STDP with synaptic fatigue for learning of spike-time-coded patterns in the presence of parallel rate-coding

A method comprising:

• providing, by machine logic, at least one presynaptic artificial neuron generating a sequence of presynaptic spikes having a timing;
• providing, by the machine logic, a postsynaptic artificial neuron comprising a membrane potential;
• providing, by the machine logic, a learning rule circuit comprising a synaptic efficacy and a synaptic plasticity;
• and
• providing, by the machine logic, the learning rule circuit configured to learn temporal correlations in the respective timing of the presynaptic spikes by discounting, using a rate-normalized covariance matrix, correlations in spike rates associated with the sequence of presynaptic spikes, the discounting including modifying synaptic efficacies for clusters, in the rate-normalized covariance matrix, having covaryinq frequency higher than a preset threshold, and to modify the synaptic efficacy using a learning rule,
• wherein:
• the learning rule is based on the timing and the spike rates;
• the learning rule circuit comprises either:
• (i) a normalized covariance circuit configured to, using the learning rule, generate the rate-normalized covariance matrix based on the sequence of presynaptic spikes and a clustering circuit configured to modify the synaptic efficacy according to clusters in the normalized covariance matrix, or (ii) at least one plastic synapse that is operatively connected to the at least one presynaptic artificial neuron to receive the sequence of presynaptic spikes and modify the postsynaptic membrane potential based on the synaptic efficacy and the sequence of presynaptic spikes;
• the synaptic efficacy comprises a weighting and a rate-normalization, and
• the at least one plastic synapse comprises a Hebbian plasticity circuit configured to modify the weighting, and a rate-dependent plasticity circuit configured to modify the rate-normalization;
• the Hebbian plasticity circuit comprises a spike-timing-dependent plasticity rule;
• the rate-dependent plasticity circuit comprises a fatigue plasticity rule;
• the sequence of presynaptic spikes is characterized by a spike rate and the rate-dependent plasticity circuit is configured to, using the fatigue plasticity rule, modify the rate-normalization so that each spike in the sequence of presynaptic spikes has a reduced effect on the membrane potential when the spike rate increases;
• and
• the at least one plastic synapse comprises either:
• (i) a non-volatile memory element with volatile characteristics that match the fatigue plasticity rule, or (ii) a digital complementary metal oxide semiconductor (CMOS) circuit or an analog CMOS circuit.