Apparatus with accelerated machine learning processing

An apparatus, the apparatus comprising:

• a global memory configured to store input feature map (IFM) data, weights, kernel data, and output feature map (OFM) data;
• and
• a convolution operation data path engine, connected to the global memory, comprising:
• an IFM fetcher unit, connected to the global memory, configured to fetch the IFM data from the global memory and form an IFM vector stream;
• a kernel fetcher unit, connected to the global memory, configured to fetch kernel data from the global memory and form a kernel vector stream;
• a systolic array, configured to receive the IFM vector stream and the kernel vector stream, comprising a plurality of processing elements (PEs) each having a plurality of vector units, each of the plurality of vector units being configured to perform a dot-product operation on an IFM vector of the IFM vector stream and a kernel vector of the kernel vector stream per unit clock cycle to generate output feature maps (OFMs);
• and
• an OFM write-back unit configured to collect and write the OFMs to the global memory.