Distributed processing management server, distributed system, distributed processing management program and distributed processing management method

A distributed processing management device, which is connected with N-unit (N is a plural) of data devices belonging to M-set (M is one or more) of data device groups each of which includes one or more of the data devices and stores a subset of a set of complete data, which is a group of data elements each belonging to each of one or more prescribed data sets, and J-unit (J is a plural) of processing devices which acquire the complete data from one of the data device groups, comprising:

• a load computation unit which, for each combination of the processing device and the data device group, acquires each inter-device communications load which is a communications load which occurs when the processing device receives data of unit data volume from each data device in the data device group, and computes a complete data unit quantity acquisition load c which is the communications load which occurs when the processing device receives data from one or more the data devices belonging to the data device group in order to obtain the complete data of the unit data volume;
• and
• a processing allocation unit which determines, for each combination of the processing device and the data device group, a nonnegative amount of the communication volume f of which the processing device receives data from the one or more data devices of the data device group so that a prescribed sum of the product of the communication volume f and the complete data unit quantity acquisition load c becomes minimum, and outputs combination information of the processing device and the data device which are performing communication based on the determined communication volume f.

A distributed processing management method comprising:

• connecting a distributed processing management device with N-unit (N is a plural) of data devices belonging to M-set (M is one or more) of data device groups each of which includes one or more of the data devices and stores a subset of a set of complete data, which is a group of data elements each belonging to each of one or more prescribed data sets, and
• J-unit (J is a plural) of processing devices which acquire the complete data from one of the data device groups;
• acquiring, for each combination of the processing device and the data device group, each inter-device communications load which is a communications load which occurs when the processing device receives data of unit data volume from each data device in the data device group;
• computing, a complete data unit quantity acquisition load c which is the communications load which occurs when the processing device receives data from one or more the data devices belonging to the data device group in order to obtain the complete data of the unit data volume;
• determining, for each combination of the processing device and the data device group, a nonnegative amount of the communication volume f of which the processing device receives data from one or more the data devices of the data device group so that a prescribed sum of the product of the communication volume f and the complete data unit quantity acquisition load c becomes a minimum;
• and
• outputting combination information of the processing device and the data device which are performing communication based on the determined communication volume f.

A non-transient computer readable recording medium having embodied thereon a distributed processing management program, which when executed by a computer which is connected with N-unit (N is a plural) of data devices belonging to M-set (M is one or more) of data device groups each of which includes one or more of the data devices and stores a subset of a set of complete data, which is a group of data elements each belonging to each of one or more prescribed data sets, and J-unit (J is a plural) of processing devices which acquire the complete data from one of the data device groups, causes the computer to process the following processing of:

• load computation processing for acquiring, for each combination of the processing device and the data device group, each inter-device communications load which is a communications load which occurs when the processing device receives data of unit data volume from each data device in the data device group, and computing a complete data unit quantity acquisition load c which is the communications load which occurs when the processing device receives data from the data device belonging to the data device group in order to obtain the complete data of the unit data volume;
• and
• processing allocation processing for determining, for each combination of the processing device and the data device group, a nonnegative amount of the communication volume f of which the processing device receives data from the one or more data devices of the data device group so that a prescribed sum of the product of the communication volume f and the complete data unit quantity acquisition load c becomes a minimum, and outputting combination information of the processing device and the data device which are performing communication based on the determined communication volume f.

A distributed processing management device, which is connected with

• N-unit (N is a plural) of data devices belonging to M-set (M is one or more) of data device groups each of which includes one or more of the data devices and stores a subset of a set of complete data, which is a group of data elements each belonging to each of one or more prescribed data sets, and
• J-unit (J is a plural) of processing devices which acquire the complete data from one of the data device groups, comprising:
• a load computation means for, for each combination of the processing device and the data device group,
• acquiring each inter-device communications load which is a communications load which occurs when the processing device receives data of unit data volume from each data device in the data device group, and
• computing a complete data unit quantity acquisition load c which is the communications load which occurs when the processing device receives data from one or more the data devices belonging to the data device group in order to obtain the complete data of the unit data volume;
• and
• a processing allocation means for, determining, for each combination of the processing device and the data device group, a nonnegative amount of the communication volume f of which the processing device receives data from the one or more data devices of the data device group so that a prescribed sum of the product of the communication volume f and the complete data unit quantity acquisition load c becomes a minimum, and outputting combination information of the processing device and the data device which are performing communication based on the determined communication volume f.