Distributed processing device and distributed processing system as well as distributed processing method

A distributed processing method that is executed on a computer that activates at least one of a plurality of processes activated by a plurality of computers, comprising:

• executing a local collective communication among the plurality of processes within one process group among a plurality of process groups generated by partitioning said plurality of processes activated by the plurality of computers by a first partitioning pattern;
• selecting, after said local collective communication, a second partitioning pattern different from said first partitioning pattern used in said local collective communication;
• and
• executing, using data based on a result of said local collective communication, a next local collective communication among a plurality of processes within one process group among the plurality of process groups generated by partitioning said plurality of processes by said second partitioning pattern,
• wherein selection of said second partitioning pattern is made, after said local collective communication is repeated a predetermined number of times, based on such a selection order of a plurality of partitioning patterns including said first and second partitioning patterns as to allow data reflecting a plurality of pieces of target data that said plurality of processes activated by the plurality of computers have to be shared among said plurality of processes activated by the plurality of computers.

A distributed processing device that activates at least one of a plurality of processes activated by a plurality of distributed processing devices wherein said at least one of the plurality of processes comprises:

• collective communication means for executing local collective communication among a plurality of processes activated by the plurality of distributed processing devices within one process group among a plurality of process groups generated by partitioning said plurality of processes by a first partitioning pattern;
• and
• communication control means for selecting, after the local collective communication, a second partitioning pattern different from said first partitioning pattern used in said local collective communication, and allowing said collective communication means to execute a next local collective communication using data based on a result of said local collective communication among the plurality of processes within one process group among the plurality of process groups generated by partitioning said plurality of processes by said second partitioning pattern,
• wherein after said local collective communication is repeated a predetermined number of times, said communication control means is further for retaining such a selection order of a plurality of partitioning patterns including said first and second partitioning patterns as to allow data reflecting a plurality of pieces of target data that said plurality of processes have to be shared among said plurality of processes and selecting a partitioning pattern to be used for said next local collective communication based on said selection order.