US 2022/0101084 A1Published application

Pipelining for analog-memory-based neural networks with all-local storage

AssigneeInternational Business Machines Corporation

InventorGeoffrey Burr

Life of this patent

Estimating the term…

Loading patent…

Abstract

Pipelining for analog-memory-based neural networks with all-local storage is provided. In various embodiments, an array of inputs is received by a first synaptic array in a hidden layer from a prior layer during a feed forward operation. The array of inputs is stored by the first synaptic array during the feed forward operation. The array of inputs is received by a second synaptic array in the hidden layer during the feed forward operation. The second synaptic array computes outputs from array of inputs based on weights of the second synaptic array during the feed forward operation. The stored array of inputs is provided from the first synaptic array to the second synaptic array during a back propagation operation. Correction values are received by the second synaptic array during the back propagation operation. Based on the correction values and the stored array of inputs, the weights of the second synaptic array are updated.

Claims20

Dependent claims

An artificial neural network, comprising a plurality of synaptic arrays, wherein:

each of the plurality of synaptic arrays comprises a plurality of ordered input wires, a plurality of ordered output wires, and a plurality of synapses;
each of the synapses is operatively coupled to one of the plurality of input wires and to one of the plurality of output wires;
each of the plurality of synapses comprises a resistive element configured to store a weight;
the plurality of synaptic arrays are configured in a plurality of layers, comprising at least one input layer, one hidden layer, and one output layer;
a first of the at least one of the synaptic arrays in the at least one hidden layer is configured to receive and store an array of inputs from a prior layer during a feed forward operation;
a second of the at least one of the synaptic arrays in the at least one hidden layer is configured to receive the array of inputs from the prior layer, and compute outputs from the at least one hidden layer based on the weights of the second synaptic array during the feed forward operation;
the first of the at least one of the synaptic arrays is configured to provide the stored array of inputs to the second of the at least one of the synaptic arrays during a back propagation operation;
and
the second of the at least one of the synaptic arrays is configured to receive correction values during the back propagation operation, and based on the correction values and the stored array of inputs, update its weights.

6 more elements

Dependencies are inferred from the claim text.