# US 2019/0244077 A1 · Systolic neural network engine capable of forward propagation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244077 A1
- Document ID: US20190244077A1
- Status: Published application
- Kind: A1
- Application number: 15/981,624
- Filed: 2018-05-16
- Published: 2019-08-08
- Earliest claimed: 2018-02-08
- Assignees: Western Digital Technologies, Inc.
- Applicants: Western Digital Technologies, Inc.
- Inventors: Luiz M. Franca-Neto
- Web page: https://patentgrep.com/patent/US20190244077A1

## CPC

- G06N 3/063: using electronic means
- G06F 15/8046: {Systolic arrays}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/0499: Feedforward networks
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 5/046: Forward inferencing; Production systems
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method of computer processing is disclosed comprising receiving a data packet at a processing node of a neural network, performing a calculation of the data packet at the processing node to create a processed data packet, attaching a tag to the processed data packet, transmitting the processed data packet from the processing node to a receiving node during a systolic pulse, receiving the processed data packet at the receiving node, performing a clockwise convolution on the processed data packet and a counter clockwise convolution on the processed data packet, performing an adding function and backpropagating results of the performed sigmoid function to each of the processing nodes that originally processed the data packet.

## Claims

### Claim 1

A device for performing computations of a neural network comprising at least a first layer and a second layer, the device comprising:
a first processing unit configured to perform computations of a first node of the first layer of the neural network, the first processing unit including:
a first input systolic element,
first processing circuitry configured to receive data from the first input systolic element and perform processing according to the first node to generate a first activation output; and
a first output systolic element configured to receive the first activation output from the first processing circuitry; and
a second processing unit configured to perform computations of a second node of the second layer of the neural network, wherein the second processing unit includes a second input systolic element,
wherein the first output systolic element is further configured to systolically pulse the first activation output to the second input systolic element.

### Claim 2 (depends on 1)

The device of claim 1, further comprising a third processing unit configured to perform computations of a third node of the first layer of the neural network, the third processing unit including a second output systolic element, wherein the first output systolic element systolically pulses the first activation output to the second input systolic element during a first systolic pulse, and wherein the first output systolic element is further configured to systolically pulse the first activation output to the second output systolic element during the first systolic pulse.

### Claim 3 (depends on 2)

The device of claim 2, wherein the second output systolic element is further configured to systolically pulse a second activation output to the first output systolic element during the first systolic pulse.

### Claim 4 (depends on 1)

The device of claim 1, further comprising a third processing unit configured to perform computations of a third node of the second layer of the neural network, the third processing unit including a third input systolic element, wherein the second output systolic element is configured to systolically pulse the first activation output to the third input systolic element.

### Claim 5 (depends on 1)

The device of claim 1, further comprising:
a first arrangement of a first plurality of processing units including the first processing unit, wherein at least a subset of the first plurality of processing units is configured to perform computations of a corresponding number of nodes of the first layer of the neural network;
a second arrangement of a second plurality of processing units including the second processing unit, wherein at least a subset of the second plurality of processing units is configured to perform computations of a corresponding number of nodes of the second layer of the neural network; and
a crossover connection between an output systolic element of one of the first plurality of processing units and an input systolic element of one of the second plurality of processing units.

### Claim 6 (depends on 1)

The device of claim 1, wherein the device further includes a systolic processor chip, and wherein the first and second processing units comprise circuitry embedded in the systolic processor chip.

### Claim 7 (depends on 1)

The device of claim 1, wherein the first output systolic element is further configured to tag the first activation output with an identifier, wherein the identifier identifies that the first activation output was computed by the first processing unit.

### Claim 8 (depends on 7)

The device of claim 7, wherein the first activation output systolically pulsed to the second input systolic element includes the tag.

### Claim 9 (depends on 8)

The device of claim 8, wherein the second processing unit includes second processing circuitry configured to receive the first activation output and perform processing according to the second node to generate a second activation output, and wherein the second processing unit uses the tag to identify a weight to use for processing the first activation output.

### Claim 10

A method for performing computations of a neural network comprising at least a first layer and a second layer, the method comprising:
assigning a first data processing unit (DPU) to perform computations of a first node of the first layer of the neural network;
assigning a second DPU to perform computations of a second node the second layer of the neural network;
performing computations of the first node of the first layer using the first DPU to generate a first activation output;
transmitting the first activation output to a first output systolic element of the first DPU;
systolically pulsing the first activation output from the first output systolic element to a first input systolic element of the second DPU during a first systolic pulse; and
performing computations of the second node of the second layer by using the second DPU to process at least the first activation output,
wherein the method is performed by at least one processor.

### Claim 11 (depends on 10)

The method of claim 10, further comprising systolically pulsing the first activation output through a plurality of input systolic elements of a corresponding plurality of DPUs assigned to perform computations of the second layer.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
systolically pulsing the first activation output to an output systolic element of a first additional DPU assigned to perform computations of the first layer; and
systolically pulsing the first activation output from the output systolic element of the first additional DPU over a crossover connection to an input systolic element of a second additional DPU assigned to perform computations of the second layer.

### Claim 13 (depends on 10)

The method of claim 10, wherein the computations of the second node include a multiplication of the first activation output pulsed to the second input systolic element with a weight.

### Claim 14 (depends on 13)

The method of claim 13, wherein the weight is stored locally at the second node.

### Claim 15 (depends on 13)

The method of claim 13, wherein the weight is retrieved from a memory external to the second node.

### Claim 16 (depends on 13)

The method of claim 13, wherein the multiplication is performed by a feedback convolution engine, the method further comprising feeding the multiplied first activation output back into the feedback convolution engine during processing of another activation output.

### Claim 17 (depends on 16)

The method of claim 16, further comprising identifying the weight from among a plurality of weights based on information indicative of an origin address of the first activation output.

### Claim 18

A non-transitory computer-readable medium storing computer-executable instructions that, when executed by a processor, cause the processor to perform operations comprising:
performing, using a first processing unit, computations of a first node of a neural network to generate a first activation output, the first node included in a first layer of the neural network;
systolically pulsing the first activation output from the first processing unit to a second processing unit assigned to perform computations of a second node of the neural network, the second node included in a second layer of the neural network; and
performing computations of the second node by using the second processing unit to process at least the first activation output to generate a second activation output.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, the operations further comprising, by the first processing unit, tagging the first activation output with an origin address identifying its origin as the first processing unit.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage of claim 19, the operations further comprising, by the second processing unit, identifying a weight with which to multiply the first activation output based on the origin address.

### Claim 21

A device for performing computations of a neural network comprising at least first, second, and third layers, the device comprising:
a first systolic processing chip including at least:
a first arrangement of first processing units, wherein at least a subset of the first processing units are assigned to perform computations of corresponding nodes of the first layer of the neural network, and
a second arrangement of second processing units, wherein at least a subset of the second processing units are assigned to perform computations of corresponding nodes of the second layer of the neural network, and wherein the first arrangement of first processing units is configured to systolically pulse data to the second arrangement of second processing units.
