On-chip communication system for neural network processors
AssigneeAlibaba Group Holding Limited
InventorJian CHEN
Life of this patent
Estimating the term…
Abstract
The present disclosure provides an on-chip communication system for neural network processors, a processing device, and a method for operating on an on-chip communication system. The system can include a cluster manager configured to generate a global signal, and a plurality of tile units in a tile array coupled with the cluster manager, each including two connectors and a node connected between the two connectors.
Claims29
An on-chip communication system for artificial neural network processors, comprising:
- a cluster manager configured to generate a global signal;
- a bus;
- and
- a plurality of tile units communicatively coupled with the cluster manager via the bus, wherein each tile unit includes a first set of connectors and at least one node that is connected between at least two connectors of the first set of connectors, wherein the at least one node is configured to acquire the global signal.
A processing device communicatively coupled to one of a first set of connectors via a first terminal and to another one of the first set of connectors via a second terminal, comprising:
- a bypass bus connected between the first and second terminals and configured to communicate data signals between the first and second terminals;
- a buffer bus connected between the first and second terminals and configured to buffer the data signals;
- and
- one or more multiplexers configured to enable one of the bypass bus and the buffer bus according to a mode signal.
A method for operating on an on-chip communication system, wherein the on-chip communication system includes a cluster manager and a plurality of tile units in a tile array communicatively coupled with the cluster manager via a bus, the method comprising:
- receiving a task;
- determining available tile units of the tile array coupled with the cluster manager, wherein each tile unit includes a first set of connectors and at least one node that is connected between the first set of connectors;
- generating a global signal according to the available tile units of the tile array;
- and
- connecting the available tile units into a ring topology based on the global signal.
Dependencies are inferred from the claim text.