Distributed synchronization scheme

A method, comprising:

• generating, by a compiler computing module, dependency instructions, based on a machine-learning model, indicating dependencies between computation-control units;
• generating, by a first computation-control unit of a machine-learning accelerator (MLA), after completion of a first operation, a synchronization token representing the completion of the first operation, the synchronization token specifying a recipient identifier for an intended recipient computation-control unit of the synchronization token;
• configuring, by a second computation-control unit of the MLA, according to the dependency instructions, dependency conditions for performing operations;
• receiving, by the second computation-control unit, the synchronization token based on the recipient identifier;
• updating, by the second computation-control unit, a dependency state to reflect the received synchronization token;
• and
• executing, by the second computation-control unit, an operation in response to a determination that the dependency state satisfies an associated dependency condition.

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

• generating, by a compiler computing module, dependency instructions, based on a machine-learning model, indicating dependencies between the computation-control units;
• generating, by a first computation-control unit of a machine-learning accelerator (MLA), after completion of a first operation, a synchronization token representing the completion of the first operation, the synchronization token specifying a recipient identifier for an intended recipient computation-control unit of the synchronization token;
• configuring, by a second computation-control unit of the MLA, according to the dependency instructions, dependency conditions for performing operations;
• receiving, by the second computation-control unit, the synchronization token based on the recipient identifier;
• updating, by the second computation-control unit, a dependency state to reflect the received synchronization token;
• and
• executing, by the second computation-control unit, an operation in response to a determination that the dependency state satisfies an associated dependency condition.