# US 2022/0309329 A1 · Artificial neural networks using magnetoresistive random-access memory-based stochastic computing units

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0309329 A1
- Document ID: US20220309329A1
- Status: Published application
- Kind: A1
- Application number: 17/703,015
- Filed: 2022-03-24
- Published: 2022-09-29
- Earliest claimed: 2021-03-26
- Assignees: Northwestern University
- Applicants: Northwestern University
- Inventors: Pedram Khalili Amiri
- Web page: https://patentgrep.com/patent/US20220309329A1

## CPC

- G06N 3/063: using electronic means
- G06F 7/588: {Random number generators, i.e. based on natural stochastic processes}
- G06F 7/70: using stochastic pulse trains, i.e. randomly occurring pulses the average pulse rates of which represent numbers {(conversion of analogue signals into stochastic pulse trains and vice versa H03M1/04)}
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/048: Activation functions
- G06N 3/0499: Feedforward networks
- G06N 3/065: Analogue means
- G06N 3/09: Supervised learning
- H03M 7/26: Conversion to or from stochastic codes
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)

## Abstract

A stochastic computing artificial neural network (SC-ANN) includes magnetic tunnel junction (MTJ) devices configured as true random number generators (TRNGs) to output stochastic bit-streams of random numbers for processing by input, hidden, and/or output nodes of the ANN. The processing may include multiplication by a weighting value corresponding to a respective numerical value from the stochastic bit-streams.

## Claims

### Claim 1

An artificial neural network (ANN), comprising:
a plurality of magnetic tunnel junction (MTJ) devices configured as true random number generators (TRNGs) to output stochastic bit-streams of random numbers;
a plurality of input nodes configured to receive respective numerical values for processing by the ANN;
a plurality of hidden nodes, at least one of the plurality of hidden nodes in electrical communication with one or more of the plurality of input nodes to receive and output a sum of input values from the one or more of the plurality of input nodes multiplied by a corresponding one of a plurality of first weighting values, each of the plurality of first weighting values corresponding to a respective numerical value from the stochastic bit-streams output by the MTJ devices; and
an output node in electrical communication with one or more of the plurality of hidden nodes to receive and output a sum of hidden values of the one or more of the plurality of hidden nodes multiplied by a corresponding one of a plurality of second weighting values.

### Claim 2 (depends on 1)

The ANN of claim 1, wherein numerical values of the random numbers are tuned by electrical current through the MTJ devices via spin-transfer torque.

### Claim 3 (depends on 1)

The ANN of claim 1, wherein the MTJ devices comprise a Co/Pt multilayer-based synthetic antiferromagnetic (SAF) structure.

### Claim 4 (depends on 3)

The ANN of claim 3, wherein the SAF structure comprises:
a top electrode comprising an electrically conductive material;
a first ferromagnetic layer comprising a CoFeB material disposed below the top electrode;
a tunnel barrier layer comprising a MgO material disposed below the first ferromagnetic layer;
a second ferromagnetic layer comprising a CoFeB material disposed below the tunnel barrier layer;
a coupling layer disposed below the second ferromagnetic layer;
a SAF layer disposed below the coupling layer; and
a bottom electrode comprising an electrically conductive material disposed below the SAF layer.

### Claim 5 (depends on 1)

The ANN of claim 1, wherein at least one of the plurality of MTJ devices is configured to introduce a random reshuffling mechanism.

### Claim 6 (depends on 1)

The ANN of claim 1, further comprising a digitally controlled circuit configured to convert oscillations of the MTJ devices into the stochastic bit-streams.

### Claim 7 (depends on 1)

The ANN of claim 1, further comprising a bias voltage setting circuit configured to set a bias voltage of the MTJ devices according to a training operation of the ANN.

### Claim 8 (depends on 1)

The ANN of claim 1, wherein each of the plurality of second weighting values corresponds to a respective numerical value from the stochastic bit-streams output by the MTJ devices.

### Claim 9 (depends on 1)

The ANN of claim 1, wherein each of the plurality of input nodes is further configured to multiply the input node's respective numerical value by a corresponding one of a plurality of input weighting values, each of the plurality of input weighting values corresponding to a respective numerical value from the stochastic bit-streams output by the MTJ devices.

### Claim 10 (depends on 1)

The ANN of claim 1, wherein the plurality of MTJ devices comprises an electrically coupled pair of MTJ devices.

### Claim 11

An artificial neural network (ANN), comprising:
a first plurality of magnetic tunnel junction (MTJ) devices configured as true random number generators (TRNGs) to output first stochastic bit-streams of random numbers;
a second plurality of MTJ devices configured as TRNGs to output second stochastic bit-streams of random numbers;
a third plurality of MTJ devices configured as TRNGs to output third stochastic bit-streams of random numbers;
a plurality of input nodes, each of the plurality of input nodes configured to receive a respective numerical value for processing by the ANN and multiply the respective numerical value by a corresponding one of a plurality of input weighting values, each of the plurality of input weighting values corresponding to a respective numerical value from the first stochastic bit-streams output by the first plurality of MJT devices;
a plurality of hidden nodes, one or more of the plurality of hidden nodes in electrical communication with one or more of the plurality of input nodes to receive and output a sum of input values from the one or more of the plurality of input nodes multiplied by a corresponding first weighting value, the corresponding first weighting value also corresponding to a respective numerical value from the second stochastic bit-streams output by the second plurality of MTJ devices; and
an output node in electrical communication with one or more of the plurality of hidden nodes to receive and output a sum of hidden values of the one or more of the plurality of hidden nodes multiplied by a corresponding second weighting value, the corresponding second weighting value corresponding to a respective numerical value from the third stochastic bit-streams output by the third plurality of MTJ devices.

### Claim 12 (depends on 11)

The ANN of claim 11, further comprising a bias voltage setting circuit configured to set a bias voltage of one or more of the first MTJ devices, second MTJ devices, or third MTJ devices according to a training operation of the ANN.

### Claim 13 (depends on 11)

The ANN of claim 11, further comprising a digitally controlled circuit configured to convert oscillations of one or more of the first MTJ devices, second MTJ devices, or third MTJ devices into the stochastic bit-streams.

### Claim 14 (depends on 11)

The ANN of claim 11, wherein numerical values of the random numbers are tuned by electrical current through the MTJ devices via spin-transfer torque.

### Claim 15 (depends on 11)

The ANN of claim 11, wherein one or more of the first MTJ devices, second MTJ devices, or third MTJ devices comprise a Co/Pt multilayer-based synthetic antiferromagnetic (SAF) structure.

### Claim 16 (depends on 15)

The ANN of claim 15, wherein the SAF structure comprises:
a top electrode comprising an electrically conductive material;
a first ferromagnetic layer comprising a CoFeB material disposed below the top electrode;
a tunnel barrier layer comprising a MgO material disposed below the first ferromagnetic layer;
a second ferromagnetic layer comprising a CoFeB material disposed below the tunnel barrier layer;
a coupling layer disposed below the second ferromagnetic layer;
a SAF layer disposed below the coupling layer; and
a bottom electrode comprising an electrically conductive material disposed below the SAF layer.

### Claim 17 (depends on 11)

The ANN of claim 11, wherein at least one of the plurality of MTJ devices is configured to introduce a random reshuffling mechanism.

### Claim 18 (depends on 11)

The ANN of claim 11, wherein the first plurality of MTJ devices comprise an electrically coupled pair of MTJ devices.

### Claim 19

An artificial neural network (ANN), comprising:
a plurality of magnetic tunnel junction (MTJ) devices configured as true random number generators (TRNGs) to output stochastic bit-streams of random numbers;
a plurality of input nodes configured to process respective received numerical values for processing by the ANN; and
an output node configured to:
process one or more of intermediate values resulting from processing by at least the plurality of input nodes to generate a result value, and
output the result value;
wherein the processing includes multiplication by a weighting value corresponding to a respective numerical value from the stochastic bit-streams output by the plurality of MTJ devices.

### Claim 20 (depends on 19)

The ANN of claim 19, further comprising a plurality of hidden nodes, one or more of the plurality of hidden nodes in electrical communication with one or more of the plurality of input nodes to process values resulting from processing by at least one or more of the plurality of input nodes.
