# US 2022/0035762 A1 · Network-on-chip data processing method and device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035762 A1
- Document ID: US20220035762A1
- Status: Published application
- Kind: A1
- Application number: 17/278,812
- Filed: 2019-10-18
- Published: 2022-02-03
- Earliest claimed: 2018-10-18
- Assignees: Shanghai Cambricon Information Technology Co., Ltd.
- Applicants: Shanghai Cambricon Information Technology Co., Ltd.
- Inventors: Yao ZHANG; Shaoli LIU; Jun LIANG; Yu CHEN
- Web page: https://patentgrep.com/patent/US20220035762A1

## CPC

- G06F 13/4068: {Electrical coupling}
- G06F 15/7825: {Globally asynchronous, locally synchronous, e.g. network on chip}
- G06F 15/17318: {Parallel communications techniques, e.g. gather, scatter, reduce, roadcast, multicast, all to all}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/063: using electronic means
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

The present application relates to a network-on-chip data processing method. The method is applied to a network-on-chip processing system, the network-on-chip processing system is used for executing machine learning calculation, and the network-on-chip processing system comprises a storage device and a calculation device. The method comprises: accessing the storage device in the network-on-chip processing system by means of a first calculation device in the network-on-chip processing system, and obtaining first operation data; performing an operation on the first operation data by means of the first calculation device to obtain a first operation result; and sending the first operation result to a second calculation device in the network-on-chip processing system. According to the method, operation overhead can be reduced and data read/write efficiency can be improved.

## Claims

### Claim 1

A network-on-chip (NoC) processing system, comprising a storage device and a plurality of computation devices, wherein the storage device and the plurality of computation devices are arranged on a same chip, at least one computation device is connected to the storage device, and at least two computation devices are directly connected to each other.

### Claim 2 (depends on 1)

The system of claim 1, wherein any two of the plurality of computation devices are directly connected to each other.

### Claim 3 (depends on 1)

The system of claim 1, wherein the plurality of computation devices include a first computation device and a plurality of second computation devices, wherein the first computation device is connected to the storage device, and at least one of the plurality of second computation devices is connected to the first computation device.

### Claim 4 (depends on 3)

The system of claim 3, wherein at least two of the plurality of second computation devices are connected to each other, and are connected to the storage device through the first computation device.

### Claim 5 (depends on 3)

The system of claim 3, wherein any two of the plurality of second computation devices are directly connected to the first computation device.

### Claim 6 (depends on 1)

The system of claim 1, wherein each of the plurality of computation devices is connected to the storage device, and at least two computation devices are connected to each other.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computation device is configured to perform a machine learning computation, and the computation device includes an operation unit and a controller unit, wherein the operation unit includes a primary processing circuit and a plurality of secondary processing circuits,
the controller unit is configured to obtain input data and a computation instruction,
the controller unit is further configured to parse the computation instruction to obtain a plurality of operation instructions, and send the plurality of operation instructions and the input data to the primary processing circuit,
the primary processing circuit is configured to perform preorder processing on the input data, and send the data and the operation instructions among the primary processing circuit and the plurality of secondary processing circuits,
the plurality of secondary processing circuits are configured to perform intermediate computations in parallel according to the data and the operation instructions sent by the primary processing circuit to obtain a plurality of intermediate results, and send the plurality of intermediate results to the primary processing circuit, and
the primary processing circuit is further configured to perform postorder processing on the plurality of intermediate results to obtain a computation result of the computation instruction.

### Claim 8 (depends on 7)

The computation device of claim 7, wherein the controller unit includes an instruction storage unit, an instruction storage processing unit, and a storage queue unit, wherein
the instruction storage unit is configured to store a computation instruction associated with the artificial neural network operation,
the instruction processing unit is configured to parse the computation instruction to obtain a plurality of operation instructions, and
the storage queue unit is configured to store an instruction queue, wherein the instruction queue includes: a plurality of operation instructions or a computation instruction to be executed in an order of the instruction queue.

### Claim at position 9

9-15. (canceled)

### Claim 16

A neural network chip, comprising a storage device, a plurality of computation devices, a first interconnection device, and a second interconnection device, wherein at least one computation device is connected to the storage device through the first interconnection device, and the plurality of computation devices are connected to each other through the second interconnection device.

### Claim 17

An NoC data processing method, wherein the method is used to perform a machine learning operation, and includes:
accessing a storage device by using a first computation device to obtain first operation data;
performing an operation on the first operation data by using the first computation device to obtain a first operation result; and
sending the first operation result to a second computation device.

### Claim 18 (depends on 17)

The method of claim 17, comprising accessing the storage device by using the second computation device to obtain second operation data.

### Claim 19 (depends on 18)

The method of claim 18, comprising performing an operation on the second operation data and the first operation result by using the second computation device to obtain a second operation result.

### Claim at position 14

20-106. (canceled)
