Automated hardware-aware deployment of machine learning pipelines on chipsets

A method for implementing a machine learning pipeline on a chip containing a plurality of hardware compute elements, the method comprising:

• accessing a hardware-agnostic functional description of the machine learning pipeline, wherein the functional description specifies a plurality of functional modules that form the pipeline, and at least one functional module includes a machine learning model;
• accessing hardware specifications of a chipset;
• identifying, based on the hardware specifications of the chipset, a plurality of hardware compute elements of the chipset;
• synthesizing, by a computer system, the pipeline of functional modules into a plurality of interconnected executable components that execute on at least two different hardware compute elements of the chipset;
• generating an implementation package comprising the executable components and specifying interconnections between the executable components;
• and
• deploying the implementation package onto the chipset, causing the executable components to be executed on the plurality of hardware compute elements of the chipset.