# US 2022/0027714 A1 · Convolution block array for implementing neural network application and method using the same, and convolution block circuit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0027714 A1
- Document ID: US20220027714A1
- Status: Published application
- Kind: A1
- Application number: 17/291,309
- Filed: 2019-04-30
- Published: 2022-01-27
- Earliest claimed: 2018-11-06
- Assignees: Genesys Logic, Inc.
- Applicants: Genesys Logic, Inc.
- Inventors: Woon-Sik SUH
- Web page: https://patentgrep.com/patent/US20220027714A1

## CPC

- G06N 3/063: using electronic means
- G06F 1/03: working, at least partly, by table look-up (G06F1/025 takes precedence)
- G06F 7/50: Adding; Subtracting (G06F7/483 - G06F7/491, G06F7/544 - G06F7/556 take precedence)
- G06F 7/523: Multiplying only
- G06F 7/53: in parallel-parallel fashion, i.e. both operands being entered in parallel (G06F7/533 takes precedence)
- G06F 7/5443: {Sum of products (for applications thereof, see the relevant places, e.g. G06F17/10, H03H17/00)}
- G06F 9/54: Interprogram communication
- G06N 3/045: Combinations of networks
- G06N 3/048: Activation functions
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A convolution block array for implementing neural network application, a method using the same, and a convolution block circuit are provided. The convolution block array includes a plurality of convolution block circuits configured to process a convolution operation of the neural network application, wherein each of the convolution block circuits comprises: a plurality of multiplier circuits configured to perform the convolution operation; and at least one adder circuit connected to the plurality of multiplier circuits and configured to perform an adding operation of results of the convolution operation and generate an output signal; where at least one of the convolution block circuits is configured to perform a biasing operation of the neural network application.

## Claims

### Claim 1

A convolution block array for implementing a neural network application, comprising:
a plurality of convolution block circuits configured to process a convolution operation of the neural network application, wherein each of the convolution block circuits comprising:
a plurality of multiplier circuits configured to perform the convolution operation; and
at least one adder circuit connected to the plurality of multiplier circuits and configured to perform an adding operation of results of the convolution operation and generate an output signal;
wherein at least one of the convolution block circuits is configured to perform a biasing operation of the neural network application.

### Claim 2 (depends on 1)

The convolution block array as claimed in claim 1, wherein each of the convolution block circuits comprises four multiplier circuits, a first convolution adder circuit, a second convolution adder circuit, and a block adder circuit;
wherein two multiplier circuits of the four multiplier circuits are connected to the first convolution adder circuit, and another two multiplier circuits of the four multiplier circuits are connected to the second convolution adder circuit, and
the block adder circuit is connected to the first convolution adder circuit and the second convolution adder circuit.

### Claim 3 (depends on 1)

The convolution block array as claimed in claim 1, wherein the convolution block further comprises a latch connected to the at least one adder circuit and also connected to at least one downstream convolution block circuit; wherein the latch is configured to transmit the output signal to the at least one downstream convolution block circuit or fed the output signal back to the at least one adder circuit.

### Claim 4 (depends on 3)

The convolution block array as claimed in claim 3, wherein the convolution block array further comprises:
a plurality of multiplexers connected to the plurality of multiplier circuits respectively, wherein the multiplier circuits are connected to the at least one adder circuit via respective multiplexer; and
a path controller connected to the plurality of multiplexers and also connected to at least one upstream convolution block circuit, wherein when a corresponding path of the path controller is enabled, an output signal from the at least one upstream convolution block circuit transmits to the at least one adder circuit via the path controller.

### Claim 5 (depends on 1)

The convolution block array as claimed in claim 1, wherein the convolution operation is executed by multiplying feature values by weight coefficients and adding a biasing coefficient.

### Claim 6

A method of implementing neural network application in a convolution block array, wherein the convolution block array comprising a plurality of convolution block circuits, and each of the convolution block circuits comprises a plurality of multiplier circuits and at least one adder circuit, and the method comprises:
S10, assigning a set of convolution block circuits in a first dimension to process a convolution operation of the neural network application;
S20, inputting a control signal to the set of convolution block circuits for controlling the set of convolution block circuits to perform M×M filter window involving N-bit based convolution operation, wherein M is an odd number and N is an integer greater than one;
S30, inputting feature values and filter values to the set of convolution block circuits;
S40, performing an N-bit multiplication function with the feature values and the filter values corresponding values of input images by the multiplier circuits of the convolution block circuit;
S50, adding results from the multiplier circuits by the at least one adder circuit; and
S60, generate a convolution output signal.

### Claim 7 (depends on 6)

The method as claimed in claim 6, wherein the step S10 comprises: according to a combination of the M×M filter window and the N-bit of the convolution operation, determine use a number of the convolution block circuits for performing the convolution operation of one pixel of the convolution block circuits, and the number of the convolution block circuits arranged in a line based.

### Claim 8 (depends on 7)

The method as claimed in claim 7, wherein the filter values of one pixel comprises weight coefficients and a biasing coefficient, and in a last convolution block circuit for performing convolution operation of each pixel, the biasing coefficient passes to the at least one adder circuit through an idle multiplier circuit of the plurality of multiplier circuits of the last convolution block circuit.

### Claim 9 (depends on 8)

The method as claimed in claim 8, wherein after the step S50, the method comprises:
S51, adding the results by the at least one adder circuit of each convolution block circuit to generate a partial output signal;
S52, transmitting all of partial output signals to the last convolution block circuit; and
S53, adding the all of partial output signals by the at least one adder circuit of the last convolution block circuit, and generating the convolution output signal representing one pixel.

### Claim 10 (depends on 8)

The method as claimed in claim 8, wherein each of the convolution block circuits comprises a latch connected to the at least one adder circuit and also connected to the last convolution block circuit, and wherein after the step S51, the last convolution block circuit temporarily stores the partial output signal in the latch, and then in the step S52, the last convolution block circuit feeds the partial output signal back to its the at least one adder circuit.

### Claim 11

A convolution block circuit, comprising:
four multiplier circuits configured to perform a M×M filter window involving N-bit based convolution operation;
a first convolution adder circuit connected to two multiplier circuits of the four multiplier circuits and configured to add results of the convolution operation from the two multiplier circuits;
a second convolution adder circuit connected to another two multiplier circuits of the four multiplier circuits and configured to add results of the convolution operation from the two multiplier circuits;
a block adder circuit connected to the first convolution adder circuit and the second convolution adder circuit and configured to perform a first adding operation and a second adding operation, wherein in the first adding operation, the block adder circuit adds results of partial convolution operations from the first convolution adder circuit and the second convolution adder circuit and a biasing coefficient, and generates a first convolution value, wherein the biasing coefficient transmits to the block adder circuit through an idle multiplier circuit of the four multiplier circuits; and
a latch connected to the block adder circuit configured to fed the first convolution value back to the block adder circuit;
wherein in response to the block adder circuit receive the first convolution value and other partial output signals from upstream convolution block circuits, the block adder circuit performs the second adding operation to add the first convolution value and the other partial output signals, and generates a convolution output signal.
