Collective communication apparatus in multiprocessor system

A collective communication apparatus in a multiprocessor system constituted by a plurality of processors connected by communication paths, said communication paths having various performance levels, wherein each processor comprises:

• (a) a processor group defining unit for defining processor groups, each of said groups comprising processors capable of implementing data transfer on a communication path of equal performance level, from the plurality of processors connected by the communication paths having various performance levels, and creating lists of the processor groups on a per-performance basis in terms of the performance of the communication paths;
• (b) a collective communication execution control unit for controlling and deciding, in dependence upon a type of collective communication and on the basis of the lists, the order in which communication is executed;
• and
• (c) a list-referring collective communication execution unit for referring to the lists and performing collective communication with the processors in accordance with the order controlled and decided by said collective communication execution control unit.

A collective communication method in a multiprocessor system constituted by a plurality of processors connected by communication paths, said communication paths having various performance levels, the method comprises:

• (a) a processor group defining step which defines sets of processors or previously decided master processors, which participate in program execution and which are connected by communication paths of equal performance levels when a multiprocessor program is executed, as processor groups in dependence upon the performance levels of the communication paths, to create processor group lists on a per-performance level basis upon deciding a provisional master processor in any of the groups of processors;
• (b) a master-processor registration updating step which updates the created processor group lists in such a manner that a root processor specified by a collective communication request will become a master processor;
• (c) a collective communication execution control step which presents the processor group lists in order of increasing performance, namely from lists of groups of processors connected by communication paths of lower performance to lists of groups of processors connected by communication paths of higher performance, if the collective communication request is a scatter request, and in order of decreasing performance, namely from lists of groups of processors connected by communication paths of higher performance to lists of groups of processors connected by communication paths of lower performance, if the collective communication request is a gather request;
• and
• (d) a list-referring collective communication execution step which refers to the lists delivered from said collective communication execution control step and, if a processor which performs said list-referring collective communication execution step is included in any of the lists, performs collective communication with all processors included in the list.

A collective communication method in a multiprocessor system constituted by a plurality of processors connected by communication paths, said communication paths having various performance levels, wherein in each processor the following steps are executed:

• (a) a processor group defining step which defines processor groups, each of said groups comprising processors capable of implementing data transfer on a communication path of equal performance level, from the plurality of processors connected by the communication paths having various performance levels, to create lists of the processor groups on a per-performance basis in terms of the performance of the communication paths;
• (b) a collective communication execution control step which controls and decides, in dependence upon a type of collective communication and on the basis of the lists, the order in which communication is executed;
• and
• (c) a list-referring collective communication execution step which refers to the lists and performs collective communication with the processors in accordance with the order controlled and decided by said collective communication execution control step.