Parallel computing system, synchronization device, and control method of parallel computing system

A synchronization device in a parallel computing system including a plurality of nodes each provided with a synchronization device that establishes synchronization by awaiting incoming data and transmitting the data when all awaited data is received, the synchronization device comprising:

• a receiver that receives data from at least two synchronization devices establishing synchronization, and extracts synchronization information and register selection information from the received data, the register selection information indicating one of first synchronization and second synchronization;
• a transmitter that transmits data to each of the at least two synchronization devices from among a plurality of synchronization devices;
• a first receiving state register that stores the extracted synchronization information of the first synchronization;
• a second receiving state register that stores the extracted synchronization information of the second synchronization;
• and
• a controller that stores
• the extracted synchronization information into the first receiving state register and the second receiving state register alternately based on the register selection information, and
• controls the transmitter to transmit data including the register selection information to each of the at least two synchronization devices when the extracted synchronization information is stored in one of the first receiving state register and the second receiving state register.

A method of controlling a parallel computing system including a plurality of nodes each provided with a synchronization device that establishes synchronization by awaiting incoming data and transmitting the data when all awaited data is received, the method comprising:

• receiving data from at least two synchronization devices establishing synchronization;
• extracting synchronization information and register selection information from the received data, the register selection information indicating one of first synchronization and second synchronization;
• storing the extracted synchronization information into a first receiving state register and a second receiving state register alternately based on the register selection information, and the first receiving state register being for storing the extracted synchronization information of the first synchronization, the second receiving state register being for storing the extracted synchronization information of the second synchronization;
• and
• transmitting data including the register selection information to each of the at least two synchronization devices when the extracted synchronization information is stored in one of the first receiving state register and the second receiving state register.