# US 2021/0081772 A1 · Reservoir computer, reservoir designing method, and non-transitory computer-readable storage medium for storing reservoir designing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081772 A1
- Document ID: US20210081772A1
- Status: Published application
- Kind: A1
- Application number: 16/987,457
- Filed: 2020-08-07
- Published: 2021-03-18
- Earliest claimed: 2019-09-12
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Shoichi MIYAHARA
- Web page: https://patentgrep.com/patent/US20210081772A1

## CPC

- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/063: using electronic means
- G06F 15/76: Architectures of general purpose stored program computers (with program plugboard G06F15/08; multicomputers G06F15/16)
- G06N 3/042: Knowledge-based neural networks; Logical representations of neural networks
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/08: Learning methods
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/086: using evolutionary algorithms, e.g. genetic algorithms or genetic programming
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06F 2015/768: {Gate array}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A reservoir designing method executed by a computer configured to control a neural network including a reservoir and an output layer, the reservoir including a plurality of nodes and having a coupling structure randomly determined between the plurality of nodes, the output layer having a weight set on each node of the plurality of nodes. In an example, the method includes: changing the coupling structure between the plurality of nodes included in the reservoir; computing an output for an input to the neural network; updating the weight of the output layer based on the output for each of the coupling structures changed by the changing; evaluating the output according to a predetermined criterion; and selecting a predetermined coupling structure from the coupling structures changed by the changing based on an evaluation result obtained by the evaluating.

## Claims

### Claim 1

A reservoir computer comprising:
processor circuitry configured to
execute a computation processing configured to compute an output for an input to a neural network, the neural network including a reservoir and output layer, the reservoir including a plurality of nodes and having a coupling structure randomly determined between the plurality of nodes, the output layer having a weight set on each node of the plurality of nodes;
execute a change processing configured to change the coupling structure between the plurality of nodes included in the reservoir;
execute an updating processing configured to update the weight of the output layer based on the output computed by the computation processing for each of the coupling structures changed by the change processing;
execute an evaluation processing configured to evaluate the output computed by the computation processing according to a predetermined criterion; and
execute a selection processing configured to select a predetermined coupling structure from the coupling structures changed by the change processing based on an evaluation result obtained by the evaluation processing.

### Claim 2 (depends on 1)

The reservoir computer according to claim 1, wherein
the change processing is configured to change the coupling structure by a predetermined number of times,
the evaluation processing is configured to compute, as the evaluation result, an error of the output computed by the computation processing, the error of the output being a difference between the output and training data prepared in advance, and
the selection processing is configured to select a coupling structure with the minimum error from the coupling structures changed by the change processing.

### Claim 3 (depends on 1)

The reservoir computer according to claim 1, wherein
the evaluation processing is configured to compute, as an evaluation result, an error of the output every time an update of the weight of the output layer by the updating processing is completed for each of the coupling structures changed by the change processing, the error of the output being a difference between the output and training data prepared in advance,
the selection processing is configured to select a coupling structure corresponding to the error when the error is equal to or less than a threshold value.

### Claim 4 (depends on 1)

The reservoir computer according to claim 1, wherein
the change processing is configured to generate a coupling structure of each generation by combination and selection of coupling structures according to a genetic algorithm so that an evaluation result obtained by the evaluation processing is improved by setting a plurality of coupling structures prepared in advance as a first generation, and
the selection processing is configured to select a coupling structure from coupling structures of a predetermined generation generated by the change processing based on the evaluation result obtained by the evaluation processing.

### Claim 5 (depends on 1)

The reservoir computer according to claim 1, wherein
the reservoir is a field-programmable gate array (FPGA),
the change processing is configured to change the coupling structure by rewriting the FPGA functioning as the reservoir.

### Claim 6

A reservoir designing method executed by a computer configured to control a neural network including a reservoir and an output layer, the reservoir including a plurality of nodes and having a coupling structure randomly determined between the plurality of nodes, the output layer having a weight set on each node of the plurality of nodes, the method comprising:
changing the coupling structure between the plurality of nodes included in the reservoir;
computing an output for an input to the neural network;
updating the weight of the output layer based on the output for each of the coupling structures changed by the changing;
evaluating the output according to a predetermined criterion; and
selecting a predetermined coupling structure from the coupling structures changed by the changing based on an evaluation result obtained by the evaluating.

### Claim 7 (depends on 6)

The reservoir designing method according to claim 6, wherein
the change processing is configured to change the coupling structure by a predetermined number of times,
the evaluation processing is configured to compute, as the evaluation result, an error of the output computed by the computation processing, the error of the output being a difference between the output and training data prepared in advance, and
the selection processing is configured to select a coupling structure with the minimum error from the coupling structures changed by the change processing.

### Claim 8 (depends on 6)

The reservoir designing method according to claim 6, wherein
the evaluation processing is configured to compute, as an evaluation result, an error of the output every time an update of the weight of the output layer by the updating processing is completed for each of the coupling structures
changed by the change processing, the error of the output being a difference between the output and training data prepared in advance, the selection processing is configured to select a coupling structure corresponding to the error when the error is equal to or less than a threshold value.

### Claim 9 (depends on 6)

The reservoir designing method according to claim 6, wherein
the change processing is configured to generate a coupling structure of each generation by combination and selection of coupling structures according to a genetic algorithm so that an evaluation result obtained by the evaluation processing is improved by setting a plurality of coupling structures prepared in advance as a first generation, and
the selection processing is configured to select a coupling structure from coupling structures of a predetermined generation generated by the change processing based on the evaluation result obtained by the evaluation processing.

### Claim 10 (depends on 6)

The reservoir designing method according to claim 6, wherein
the reservoir is a field-programmable gate array (FPGA),
the change processing is configured to change the coupling structure by rewriting the FPGA functioning as the reservoir.

### Claim 11

A non-transitory computer-readable storage medium for storing a reservoir designing program which causes a processor of a computer to perform processing, the computer configured to control a neural network including a reservoir and an output layer, the reservoir including a plurality of nodes and having a coupling structure randomly determined between the plurality of nodes, the output layer having a weight set on each node of the plurality of nodes, the processing comprising:
changing the coupling structure between the plurality of nodes included in the reservoir;
updating the weight of the output layer for each of the coupling structures changed by the changing based on an output for an input to the neural network;
evaluating the output according to a predetermined criterion; and
selecting a predetermined coupling structure from the coupling structures changed by the changing based on an evaluation result obtained by the evaluating.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium according to claim 11, wherein
the change processing is configured to change the coupling structure by a predetermined number of times,
the evaluation processing is configured to compute, as the evaluation result, an error of the output computed by the computation processing, the error of the output being a difference between the output and training data prepared in advance, and
the selection processing is configured to select a coupling structure with the minimum error from the coupling structures changed by the change processing.

### Claim 13 (depends on 11)

The non-transitory computer-readable storage medium according to claim 11, wherein
the evaluation processing is configured to compute, as an evaluation result, an error of the output every time an update of the weight of the output layer by the updating processing is completed for each of the coupling structures changed by the change processing, the error of the output being a difference between the output and training data prepared in advance,
the selection processing is configured to select a coupling structure corresponding to the error when the error is equal to or less than a threshold value.

### Claim 14 (depends on 11)

The non-transitory computer-readable storage medium according to claim 11, wherein
the change processing is configured to generate a coupling structure of each generation by combination and selection of coupling structures according to a genetic algorithm so that an evaluation result obtained by the evaluation processing is improved by setting a plurality of coupling structures prepared in advance as a first generation, and
the selection processing is configured to select a coupling structure from coupling structures of a predetermined generation generated by the change processing based on the evaluation result obtained by the evaluation processing.

### Claim 15 (depends on 11)

The non-transitory computer-readable storage medium according to claim 11, wherein
the reservoir is a field-programmable gate array (FPGA),
the change processing is configured to change the coupling structure by rewriting the FPGA functioning as the reservoir.
