Streaming engine for machine learning architecture

A programmable hardware system for machine learning (ML), comprising:

• a core configured to
• receive a plurality of commands and data from a host to be analyzed and inferred via machine learning;
• transmit each command of a first subset of commands of the plurality of commands for performance-critical operations and associated data thereof to an inference engine for processing via a function call, wherein the each command of the first subset of commands and/or the associated data are encapsulated as parameters in the function call;
• an instruction streaming engine coupled to the core and further coupled to the inference engine, wherein the streaming engine is configured to
• retrieve and maintain the each command of the first subset of commands and/or the associated data from the function call at a specific location in a buffer;
• stream the each command of the first subset of commands and/or its associated data to the inference engine from the buffer;
• and
• said inference engine configured to
• retrieve the each command of the first subset of commands and/or its associated data streamed from the buffer;
• and
• perform the performance-critical operations according to the each command of the first subset of commands to analyze and infer a subject from the data.