# US 2024/0005162 A1 · Error-triggered learning of multi-layer memristive spiking neural networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005162 A1
- Document ID: US20240005162A1
- Status: Published application
- Kind: A1
- Application number: 18/037,024
- Filed: 2021-11-19
- Published: 2024-01-04
- Earliest claimed: 2020-11-20
- Assignees: The Regents of the University of California
- Applicants: University of Zurich; King Abdullah University of Science and Technology; The Regents of the University of California
- Inventors: Mohammed FOUDA; Emre NEFTCI; Fadi KURDAHI; Ahmed ELTAWIL; Melika PAYVAND
- Web page: https://patentgrep.com/patent/US20240005162A1

## CPC

- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
- G06N 3/0499: Feedforward networks
- G06N 3/065: Analogue means
- G06N 3/09: Supervised learning
- G11C 11/54: using elements simulating biological cells, e.g. neuron
- G11C 13/0007: {comprising metal oxide memory material, e.g. perovskites}
- G11C 13/004: {Reading or sensing circuits or methods}
- G11C 13/0069: {Writing or programming circuits or methods}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G11C: STATIC STORES (semiconductor memory devices H10B)

## Abstract

The present disclosure presents neural network learning systems and methods. One such method comprises receiving an input current signal; converting the input current signal to an input voltage pulse signal utilized by a memristive neuromorphic hardware of a multi-layered spiked neural network module; transmitting the input voltage pulse signal to the memristive neuromorphic hardware of the multi-layered spiked neural network module; performing a layer-by-layer calculation and conversion on the input voltage pulse signal to complete an on-chip learning to obtain an output signal; sending the output signal to a weight update circuitry module; and/or calculating, by the weight update circuitry module, an error signal and based on a magnitude of the error signal, triggering an adjustment of a conductance value of the memristive neuromorphic hardware so as to update synaptic weight values stored by the memristive neuromorphic hardware. Other methods and systems are also provided.

## Claims

### Claim 1

A neural network learning system comprising:
an input circuitry module;
a multi-layer spiked neural network with memristive neuromorphic hardware;
a weight update circuitry module, and
wherein the input circuitry module is configured to receive an input current signal and convert the input current signal to an input voltage pulse signal utilized by the memristive neuromorphic hardware of the multi-layered spiked neural network module and is configured to transmit the input voltage pulse signal to the memristive neuromorphic hardware of the multi-layered spiked neural network module;
wherein the multi-layer spiked neural network is configured to perform a layer-by-layer calculation and conversion on the input voltage pulse signal to complete an on-chip learning to obtain an output signal;
wherein the multi-layer spiked neural network is configured to transmit the output signal to the weight update circuitry module;
wherein the weight update circuitry module is configured to implement a synaptic function by using a conductance modulation characteristic of the memristive neuromorphic hardware and is configured to calculate an error signal and based on a magnitude of the error signal, trigger an adjustment of a conductance value of the memristive neuromorphic hardware so as to update synaptic weight values stored by the memristive neuromorphic hardware.

### Claim 2 (depends on 1)

The system of claim 1, wherein the memristive neuromorphic hardware comprises memristive crossbar arrays.

### Claim 3 (depends on 2)

The system of claim 2, wherein a row of a memristive crossbar array comprises a plurality of memristive devices.

### Claim 4 (depends on 3)

The system of claim 3, wherein the error signal is generated for each row of the memristive crossbar array, wherein for an individual error signal, each of the plurality of memristive devices of a row associated with the individual error signal is updated together based on a magnitude of the individual error signal.

### Claim 5 (depends on 1)

The system of claim 1, wherein the input circuitry module comprises pseudo resistors.

### Claim 6 (depends on 1)

The system of claim 1, wherein the weight update circuitry module is configured to generate a signal to update the synaptic weight values or to bypass updating the synaptic weight values based on the magnitude of the error signal.

### Claim 7 (depends on 6)

The system of claim 6, wherein the weight update circuitry module increases the synaptic weight values.

### Claim 8 (depends on 6)

The system of claim 6, wherein the weight update circuitry module decreases the synaptic weight values.

### Claim 9 (depends on 1)

The system of claim 1, wherein updating of synaptic weights are triggered based on a comparison of the magnitude of the error signal within an error threshold value.

### Claim 10 (depends on 9)

The system of claim 9, wherein the error threshold value is adjustable by the weight update circuitry module.

### Claim 11

A method comprising:
receiving an input current signal;
converting the input current signal to an input voltage pulse signal utilized by a memristive neuromorphic hardware of a multi-layered spiked neural network module;
transmitting the input voltage pulse signal to the memristive neuromorphic hardware of the multi-layered spiked neural network module;
performing a layer-by-layer calculation and conversion on the input voltage pulse signal to complete an on-chip learning to obtain an output signal;
sending the output signal to a weight update circuitry module; and
calculating, by the weight update circuitry module, an error signal and based on a magnitude of the error signal, triggering an adjustment of a conductance value of the memristive neuromorphic hardware so as to update synaptic weight values stored by the memristive neuromorphic hardware.

### Claim 12 (depends on 11)

The method of claim 11, wherein: the memristive neuromorphic hardware comprises memristive crossbar arrays, a row of a memristive crossbar array comprises a plurality of memristive devices, the error signal is generated for each row of the memristive crossbar array, and for an individual error signal, each of the plurality of memristive devices of a row associated with the individual error signal is updated together based on a magnitude of the individual error signal.

### Claim 13 (depends on 11)

The method of claim 11, further comprising generating, by the weight update circuitry module, a signal to update the synaptic weight values or to bypass updating the synaptic weight values based on the magnitude of the error signal.

### Claim 14 (depends on 11)

The method of claim 11, wherein updating of synaptic weights are triggered based on a comparison of the magnitude of the error signal within an error threshold value.

### Claim 15 (depends on 14)

The method of claim 14, wherein the error threshold value is adjustable by the weight update circuitry module.
