Architecture to support color scheme-based synchronization for machine learning

A method, comprising:

• distributing a set of task instructions to corresponding processing tiles of an inference engine to control their operations via a tile mask having an indicator to identify which processing tiles the instructions should be delivered to;
• performing one or more computation tasks by executing the set of task instructions via the plurality of processing tiles;
• and
• synchronizing the set of task instructions to be executed by each processing tile of the plurality of processing tiles, respectively, to wait current task at each processing tile to finish before starting a new one.

A system, comprising:

• a means for distributing a set of task instructions to corresponding processing tiles of an inference engine to control their operations via a tile mask having an indicator to identify which processing tiles the instructions should be delivered to;
• a means for performing one or more computation tasks by executing the set of task instructions via the plurality of processing tiles;
• and
• a means for synchronizing the set of task instructions to be executed by each processing tile of the plurality of processing tiles, respectively, to wait current task at each processing tile to finish before starting a new one.