# US 2023/0079289 A1 · Element for generating stochastic signals, stochastic neuron and neural network based on said neuron

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0079289 A1
- Document ID: US20230079289A1
- Status: Published application
- Kind: A1
- Application number: 17/760,480
- Filed: 2021-02-11
- Published: 2023-03-16
- Earliest claimed: 2020-02-13
- Assignees: Universitat De Les Illes Balears
- Applicants: Universitat De Les Illes Balears
- Inventors: Josep Lluis ROSSELLO SANZ; Christiam Camilo FRANCO FRASSER
- Web page: https://patentgrep.com/patent/US20230079289A1

## CPC

- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/063: using electronic means
- G06F 7/544: for evaluating functions by calculation {(G06F7/4824 takes precedence)}
- G06F 7/70: using stochastic pulse trains, i.e. randomly occurring pulses the average pulse rates of which represent numbers {(conversion of analogue signals into stochastic pulse trains and vice versa H03M1/04)}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/047: Probabilistic or stochastic networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present invention consists of a stochastic signal generation element comprising a binary to stochastic converter, which in turn comprises a first input for receiving a binary signal and a second input for receiving a random signal, and which is configured to convert said binary signal into a first stochastic signal using said random signal, the stochastic signal generation element being characterized in that it comprises a processing unit with a first input for receiving said first stochastic signal and a second input for receiving a reference stochastic signal, the latter being generated from a constant value signal and using said random signal, processing them according to at least one arithmetic function, the result whereof is a stochastic output signal representative of said processing. It further consists of a computational neuron that implements said stochastic signal generation element, likewise a neural network that implements said computational neuron.

## Claims

### Claim at position 1

-18. (canceled)

### Claim 19

A stochastic signal generation element (1) comprising a binary to stochastic converter (BSC), which in turn comprises a first input for receiving a binary signal (A) and a second input for receiving a random signal (R), and which is configured to convert said binary signal (A) into a first stochastic signal (A*) using said random signal (R), the stochastic signal generation element (1) being characterized in that it comprises a processing unit (11) comprising a first input for receiving said first stochastic signal (A*) and a second input for receiving a second stochastic signal (C*), the latter being generated from a constant value signal (C) and using said random signal (R), said processing unit (11) being configured to process said first stochastic signal (A*) and said reference stochastic signal (C*) in accordance with at least one arithmetic function, to generate, as a result, a stochastic output signal (S*) representative of said processing.

### Claim 20 (depends on 19)

A stochastic signal generation element (1) as claimed in claim 19, characterized in that the processing unit (11) is an OR-type logic gate, so that the arithmetic function applied thereby consists of an activation function of the rectified linear unit (ReLU) type.

### Claim 21 (depends on 19)

A stochastic neuron (10) for a computational neural network, characterized in that it comprises a stochastic signal generation element (1) as described in claim 19.

### Claim 22 (depends on 21)

A stochastic neuron (10) for a computational neural network, as claimed in claim 21, characterized in that it comprises an approximate parallel counter (APC) arranged to receive a plurality of stochastic input signals (Y1*-Yn*), which is configured to make a sum of said plurality of input signals (Y1*-Yn*) and convert them into an output signal in binary notation encoded in two's complement at its output; said output signal being the input binary signal (A) of said binary to stochastic converter (BSC).

### Claim 23 (depends on 22)

A stochastic neuron (10) for a computational neural network, as claimed in claim 22, characterized in that it comprises a plurality of processing subunits, each of these arranged to receive an external stochastic signal (X1*-Xn*) and a stochastic weight signal (w1*-wn*), and configured to process them by applying an arithmetic function, to generate output signals constituting the input stochastic signals (Y1*-Yn*) of said approximate parallel counter (APC).

### Claim 24 (depends on 23)

A stochastic neuron (10) for a computational neural network, as claimed in claim 23, characterized in that said processing subunits consist of XNOR logic gates, each configured to bipolarly multiply said external stochastic signal (X1*-Xn*) with the corresponding stochastic weight signal (w1*-wn*).

### Claim 25 (depends on 23)

A stochastic neuron (10) for a computational neural network, as claimed in claim 23, characterized in that said processing subunits consist of AND logic gates, each configured to unipolarly multiply said external stochastic signal (X1*-Xn*) with the corresponding stochastic weight signal (w1*-wn*).

### Claim 26 (depends on 21)

A computational neural network, characterized in that it comprises a plurality of stochastic neurons (10) as described in claim 21, some of said plurality of stochastic neurons (10) being operatively interconnected with others.

### Claim 27 (depends on 26)

A computational neural network, as claimed in claim 26, characterized in that it comprises a network binary to stochastic converter (BSC2), configured to generate said reference stochastic signal (C*) from a constant value signal input (C) and a random signal input (R), and simultaneously to send it to said binary to stochastic converters (BSCs) and to the different processing units (11) of said plurality of stochastic neurons (10).

### Claim 28 (depends on 27)

A computational neural network, as claimed in claim 27, characterized in that it comprises a random number generator (2) configured to generate said random signal (R), and simultaneously to send it to the different binary to stochastic converters (BSC, BSC2) of said plurality of stochastic neurons (10).

### Claim 29 (depends on 26)

A computational neural network, as claimed in claim 26, characterized in that it comprises an OR-group gate (3), configured to receive the stochastic output signals (S0*-S3*) from a group of stochastic neurons (n0-n3) and to provide the maximum value thereof at its output (Smax*).

### Claim 30 (depends on 26)

A computational neural network, as claimed in claim 26, characterized in that it comprises an array of binary to stochastic converters (BSC array), the converters thereof being configured to convert an initial signal (x) received at their respective first inputs, and to convert it, at their outputs, into an initial stochastic signal (x*), using said random signal (R) received at their respective second inputs.

### Claim 31 (depends on 26)

A computational neural network, as claimed in claim 26, characterized in that it comprises a second random number generator (2′) and an array of binary to stochastic weight converters (BSC array′), its converters being configured to convert a weight signal (w) received at a first input, and to convert it, at its output, into said stochastic weight signal (w*), using a second random signal received from the second random number generator (2′).

### Claim 32 (depends on 26)

A computational neural network, as claimed in claim 26, comprising a plurality of stochastic neurons (10), characterized in that it comprises a Max-pooling type layer, with stochastic neurons (10) comprising stochastic signal generation elements (1) the processing unit (11) whereof is an OR-type logic gate.

### Claim 33 (depends on 26)

A computational neural network, as claimed in claim 26, comprising a plurality of stochastic neurons (10), characterized in that it comprises a Min-pooling type layer, with artificial neurons (10) comprising stochastic signal generation elements (1), the processing unit (11) whereof is an AND-type logic gate.
