# US 2019/0244081 A1 · Multi-core systolic processor system for neural network processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244081 A1
- Document ID: US20190244081A1
- Status: Published application
- Kind: A1
- Application number: 15/981,735
- Filed: 2018-05-16
- Published: 2019-08-08
- Earliest claimed: 2018-02-08
- Assignees: Western Digital Technologies, Inc.
- Applicants: Western Digital Technologies, Inc.
- Inventors: Luiz M. Franca-Neto
- Web page: https://patentgrep.com/patent/US20190244081A1

## CPC

- G06N 3/063: using electronic means
- G06F 15/8046: {Systolic arrays}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/0499: Feedforward networks
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 5/046: Forward inferencing; Production systems
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method of computer processing is disclosed comprising receiving a data packet at a processing node of a neural network, performing a calculation of the data packet at the processing node to create a processed data packet, attaching a tag to the processed data packet, transmitting the processed data packet from the processing node to a receiving node during a systolic pulse, receiving the processed data packet at the receiving node, performing a clockwise convolution on the processed data packet and a counter clockwise convolution on the processed data packet, performing an adding function and backpropagating results of the performed sigmoid function to each of the processing nodes that originally processed the data packet.

## Claims

### Claim 1

A device for performing computations of a neural network comprising at least first, second, and third layers, the device comprising:
a first systolic processing chip including at least:
a first arrangement of first processing units, and
a second arrangement of second processing units, wherein the first arrangement of first processing units is configured to systolically pulse data to the second arrangement of second processing units;
a second systolic processing chip including at least a third arrangement of third processing units, wherein the second systolic processing chip is configured to receive data output from the second arrangement of first systolic processing chip and provide the data to the third arrangement of processing units; and
at least one controller configured to:
assign at least a subset of the first processing units of the first arrangement to perform computations of particular nodes of the first layer of the neural network,
assign at least a subset of the second processing units of the second arrangement to perform computations of particular nodes of the second layer of the neural network, and
assign at least a subset of the third processing units of the third arrangement to perform computations of particular nodes of the third layer of the neural network.

### Claim 2 (depends on 1)

The device of claim 1, wherein each of the first and second arrangements of processing units comprise circuitry is embedded in the first systolic processing chip.

### Claim 3 (depends on 1)

The device of claim 1, wherein:
the subset of the first processing units are configured to:
process input values of the neural network to generate first activation output values; and
systolically pulse the first activation output values to at least the subset of the second processing units; and
the subset of the second processing units are configured to process the first activation output values to generate second activation output values; and
the at least one controller is further configured to transmit the second activation output values to the third arrangement of third processing units.

### Claim 4 (depends on 3)

The device of claim 3, wherein the first systolic processing chip is configured to systolically pulse the second activation output values through the second arrangement of second processing units to a memory.

### Claim 5 (depends on 4)

The device of claim 4, wherein the at least one controller is further configured to retrieve the second activation outputs from the memory and provide the second activation outputs to the second systolic processing chip.

### Claim 6 (depends on 1)

The device of claim 1, wherein the computations of a particular one of the second processing units includes multiplication of an activation output received from one of the subset of the first processing units with corresponding weights.

### Claim 7 (depends on 6)

The device of claim 6, wherein one or more of the corresponding weights are stored locally at the one of the subset of the second processing units.

### Claim 8 (depends on 6)

The device of claim 6, wherein one or more of the corresponding weights are retrieved from a memory external to the one of the subset of the second processing units.

### Claim 9 (depends on 1)

The device of claim 1, wherein the at least one controller is further configured to:
initially configure the first and second systolic processing chips to perform forward propagation according to the neural network, and
subsequently configure the first and second systolic processing chips to back propagate deviations from expected outputs.

### Claim 10 (depends on 9)

The device of claim 9, wherein the at least one controller is further configured to update weights of the neural network based on the back propagation.

### Claim 11

A method for performing computations of a neural network comprising at least first, second, and third layers, the method comprising:
assigning at least a subset of first processing units of a first arrangement of a first systolic processing chip to the first layer of the neural network;
assigning at least a subset of second processing units of a second arrangement of the first systolic processing chip to the second layer of the neural network;
assigning at least a subset of third processing units of a third arrangement of a second systolic processing chip to the third layer of the neural network;
receiving input data of the neural network;
processing the input data using the subset of the first processing units to generate first activation output values;
systolically pulsing the first activation output values to the subset of the second processing units;
processing the first activation output values using the subset of the second processing units to generate second activation output values; and
processing the second activation output values using the subset of the third processing units of the second systolic processing chip.

### Claim 12 (depends on 11)

The method of claim 11, further comprising systolically pulsing the second activation output values through the second processing units of the second arrangement to a memory.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
retrieving the second activation outputs from the memory; and
providing the second activation outputs to the second systolic processing chip.

### Claim 14 (depends on 11)

The method of claim 11, wherein processing the first activation output values comprises, via one of the subset of second processing units, multiplying at least one of the first activation output values with a weight.

### Claim 15 (depends on 14)

The method of claim 14, further comprising retrieving the weight from a local memory of the one of the subset of second processing units.

### Claim 16 (depends on 14)

The method of claim 14, further comprising retrieving the weight from a memory external to the one of the subset of second processing units.

### Claim 17

A non-transitory computer storage medium storing computer-executable instructions that, when executed by a processor, cause the processor to perform the following method:
assigning at least a subset of first processing units of a first arrangement of a first systolic processing chip to a first layer of a neural network including at least the first layer and second and third layers;
assigning at least a subset of second processing units of a second arrangement of the first systolic processing chip to the second layer of the neural network;
assigning at least a subset of third processing units of a third arrangement of a second systolic processing chip to the third layer of the neural network;
receiving input data of the neural network;
processing the input data using the subset of the first processing units to generate first activation output values;
systolically pulsing the first activation output values to the subset of the second processing units;
processing the first activation outputs using the subset of the second processing units to generate second activation output values; and
processing the second activation output values using the subset of the third processing units of the second systolic processing chip.

### Claim 18 (depends on 17)

The non-transitory computer storage medium of claim 17, wherein the method further comprises systolically pulsing the second activation output values through the second processing units of the second arrangement to a memory.

### Claim 19 (depends on 18)

The non-transitory computer storage medium of claim 18, wherein processing the first activation output values comprises, via one of the subset of second processing units, multiplying at least one of the first activation output values with a weight.

### Claim 20 (depends on 19)

The non-transitory computer storage medium of claim 19, wherein the method further comprises retrieving the weight from a local memory of the one of the subset of second processing units.
