Hierarchical compiling and execution in a machine learning hardware accelerator

A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations for distributing executable jobs in an array of multi-core computing devices, the operations comprising:

• receiving a plurality of jobs to be executed in the array of multi-core computing devices, each multi-core computing device comprising a plurality of different types of processing cores;
• assigning each particular job of the plurality of jobs to be executed by one of the plurality of different types of processing cores by:
• analyzing the particular job to determine which of the plurality of different types of processing cores is suited to executing the particular job;
• assigning the particular job to a core type based on the analysis;
• compiling each job of the plurality of jobs into an individually executable file;
• and
• generating an execution graph representing a mapping of the individually executable files to specific ones of the plurality of different types of processing cores, wherein the execution graph identifies dependencies between individually executable files.

A system, comprising:

• one or more computers;
• and
• a computer-readable storage device coupled to the one or more computers and having instructions stored thereon which, when executed by the one or more computer, cause the one or more computers to perform operations for distributing executable jobs in an array of multi-core computing devices, the operations comprising:
• receiving a plurality of jobs to be executed in the array of multi-core computing devices, each multi-core computing device comprising a plurality of different types of processing cores;
• assigning each particular job of the plurality of jobs to be executed by one of the plurality of different types of processing cores by:
• analyzing the particular job to determine which of the plurality of different types of processing cores is suited to executing the particular job;
• assigning the particular job to a core type based on the analysis;
• compiling each job of the plurality of jobs into an individually executable file;
• and
• generating an execution graph representing a mapping of the individually executable files to specific ones of the plurality of different types of processing cores, wherein the execution graph identifies dependencies between individually executable files.