Application programming interface to wait on matrix multiply-accumulate

A system comprising:

• one or more processors;
• and
• memory storing instructions that, when executed by the one or more processors, cause the system to:
• determine, using one or more parameters of a call to an instruction, a threshold number of waiting matrix multiply-accumulate (MMA) operations to be performed by one or more threads;
• determine, using the threshold number of waiting MMA operations, whether a current number of waiting MMA operations satisfies the threshold;
• and
• cause, based on whether the current number of waiting MMA operations satisfies the threshold, one or more second threads to pause a performance of one or more MMA operations.

A method comprising:

• receiving an instruction call indicating one or more parameters;
• determining a threshold number of waiting matrix multiply-accumulate (MMA) operations to be performed by one or more threads indicated by the one or more parameters of the instruction call;
• determining, using the threshold number of waiting MMA operations, whether a current number of waiting MMA operations satisfies the threshold;
• and
• causing, based on whether the current number of waiting MMA operations satisfies the threshold, one or more second threads to pause a performance of one or more waiting MMA operations.