Back to results
US 11,886,973 B2Granted
Neural processing unit including variable internal memory
AssigneeDeepx Co., Ltd.
InventorsJungBoo Park, InSu Park, Lokwon Kim
Life of this patent
Estimating the term…
Abstract
A neural processing unit includes an internal memory including a plurality of memory units; a controller configured to control read and write operations of data in at least one of an input feature map domain, a weight domain, and an output feature map domain with respect to each of the plurality of memory units based on an operation schedule in a machine code in which a plurality of operation steps of an artificial neural network model are set.
Claims18
A neural processing unit comprising:
- an internal memory including a plurality of memory units;
- a controller configured to control read and write operations of data of at least one of an input feature map domain, a weight domain, and an output feature map domain with respect to each of the plurality of memory units based on an operation schedule in a machine code in which a plurality of operation steps of an artificial neural network model are set
- a direct memory access (DMA) configured to read data from a main memory and to write input feature map data and weight data to the internal memory;
- and
- an artificial intelligence (AI) calculation unit configured to receive and operate the input feature map data and the weight data from the internal memory to generate output feature map data
- wherein the internal memory further includes a weight multiplexer, an input feature map multiplexer, and an output feature map demultiplexer, respectively connected to each of the plurality of memory units.
3 more elements
A neural processing unit comprising:
- an internal memory including a plurality of memory units configured to store data of a first domain, a second domain, and a third domain, the plurality of memory units including a first memory unit storing the data of the first domain, a second memory unit storing the data of the second domain, and a third memory unit storing the data of the third domain;
- a direct memory access (DMA) configured to read data from a main memory and to write the data of the first domain and weight data to the data of the second domain;
- and
- an AI calculation unit including a first input unit configured to receive the data of the first domain, a second input unit configured to receive the data of the second domain, and an output unit configured to output the data of the third domain;
- a first selector configured to connect the first memory unit to the first input unit;
- a second selector configured to connect the second memory unit to the second input unit;
- and
- a third selector configured to connect the third memory unit to the output unit.
5 more elements
A system comprising:
- a main memory configured to store at least a portion of data of at least one artificial neural network model;
- and
- a neural processing unit comprising:
- a variable memory including a plurality of memory unit and at least one selectors connected to each of the plurality of memory unit and configured to select each of the plurality of memory units based on the at least one artificial neural network model, the variable memory configured to divide the portion of the data of the at least one artificial neural network model into a feature map and a weight and to selectively store the feature map and the weight in a specific unit of the plurality of memory units;
- a direct memory access (DMA) circuit configured to control a memory operation between the main memory and the variable memory;
- and
- an AI calculation unit configured to receive the feature map and the weight from the variable memory and to process an artificial neural network inference operation.
4 more elements
Dependencies are inferred from the claim text.