Systems, apparatuses, methods, and computer program products for machine learning with a long short-term memory accelerator

A system comprising:

• a long short-term memory (LSTM) accelerator comprising:
• a finite state machine (FSM) configured with a plurality of states comprising a machine learning algorithm;
• a weight memory configured to at least store a plurality of weights and a plurality of biases;
• one or more activation registers;
• a hidden state memory;
• and
• a plurality of processing elements;
• at least one processor and at least one memory coupled to the processor, wherein the processor is configured to:
• apply the machine learning algorithm of the FSM, wherein the machine learning algorithm is configured to:
• perform a plurality of operations with the plurality of processing elements including one or more matrix-vector multiplication operations, vector-vector multiplication operations, vector-vector addition operations, and non-linear activation operations;
• and
• wherein at least one non-linear activation operation comprises receiving at least one input and negating at least one negative input.