Data processing system with synchronization coprocessor for multiple threads

In a multiprocessor system comprising a plurality of processing nodes, each node processing multiple threads of computation, the system comprising at each processing node:

• a data processor which processes threads of code, the code including instructions to create messages with data values to start new threads of computation;
• and
• a synchronization coprocessor for processing messages from the same node and other nodes of the system, the synchronization coprocessor processing messages to store values from the messages as operands for the threads of computation, to determine when all operands required for the threads of computation have been received and to provide indications to the data processor that the threads of computation are to be initiated, the data processor nonsynchronously initiating processing of the threads of computation after completion of prior threads of computation in response to the indications from the synchronization coprocessor.

A data processing system comprising:

• a data processor which sequentially processes, as threads of code, code blocks including local memory load and store instructions, start instructions which cause start messages to be sent with data values to start new threads of computation and remote memory load and store instructions which cause messages to be sent to remote memory locations to fetch or store data from or in the remote memory locations;
• and
• a synchronization coprocessor which receives start messages and processes the start messages to store data values from the start messages as operands for the threads of computation, to determine when all operands required for the threads of computation have been received and to provide indications to the data processor that the threads of computation are to be initiated, the data processor nonsynchronously initiating processing of the threads of computation after completion of prior threads of computation in response to the indications from the synchronization coprocessor.