Method and apparatus for using a packet architecture to process neural networks in a neural processing unit
AssigneeExpedera, Inc.
InventorsSharad Vasantrao Chole, Shang-Tse Chuang, Siyad Chih-Hua Ma
Life of this patent
Estimating the term…
Loading patent…
AssigneeExpedera, Inc.
InventorsSharad Vasantrao Chole, Shang-Tse Chuang, Siyad Chih-Hua Ma
Estimating the term…
Artificial intelligence is an increasingly important sector of the computer industry. However, artificial intelligence is an extremely computationally intensive field such that it can be expensive, time consuming, and energy consuming field. Fortunately, many of the calculations required for artificial intelligence can be performed in parallel such that specialized processors can greatly increase computational performance for AI applications. Specifically, artificial intelligence generally requires large numbers of matrix operations such that specialized matrix processor circuits can greatly improve performance. To efficiently execute all these matrix operations, the matrix processor circuits must be quickly and efficiently supplied with a stream of data and instructions to process or else the matrix processor circuits end up idle. Thus, this document discloses packet architecture for efficiently creating and supplying neural network processors with work packets to process.
A method of processing a multi-layer neural network, the method comprising the steps of:
An apparatus for processing a multi-layer neural network having a set of neural network layers, each of the neural network layers comprising a set of input data elements and a set of output data elements, the apparatus comprising:
Dependencies are inferred from the claim text.