Multiprocessor apparatus performing collective operation, processing apparatus and operating method of processing apparatus

A processing apparatus comprising:

• memory storing data and one or more instructions;
• at least one processor configured to execute the one or more instructions;
• a memory interface circuit configured to transmit the data to the at least one processor;
• and
• a data communication circuit configured to communicate with another processing apparatus,
• wherein the data communication circuit is configured to:
• receive the data from the memory interface circuit,
• transmit the received data to the other processing apparatus,
• receive other data from the other processing apparatus, and
• transmit the received other data to the at least one processor, and
• wherein the one or more instructions, when executed by the at least one processor, cause the at least one processor to perform an operation based on the data received from the memory interface circuit and the other data received from the data communication circuit.

An operating method performed by a processing apparatus, the operating method comprising:

• generating data by the processing apparatus performing an operation;
• storing the generated data in a memory of the processing apparatus;
• performing data sharing processing for a collective operation with another processing apparatus;
• and
• performing an operation based on the data stored in the memory and other data received from the other processing apparatus via the data sharing processing,
• wherein the performing the data sharing processing comprises:
• transmitting the data stored in the memory to the other processing apparatus;
• receiving the other data from the other processing apparatus;
• and
• providing the received other data to at least one processor of the processing apparatus.