Back to results
US 10,503,560 B2Granted
Distributed processing control device
AssigneeNEC Corporation
InventorTakamitsu Ishii
Life of this patent
Estimating the term…
Abstract
A distributed processing control device includes a process accepting unit that accepts processes, a relevance acquisition unit that acquires relevance between the processes accepted by the process accepting unit; and a distributed processing instruction unit that distributively instructs a plurality of processing nodes to execute the processes accepted by the process accepting unit, based on the relevance between the processes acquired by the relevance acquisition unit.
Claims10
A distributed processing control device comprising:
- a storage device in which, in a case of performing distributed processing using a MapReduce model in which a Map process for data processing and a Reduce process that uses a process result of the Map process are performed, process relevance information showing relevance between a Map process and another Map process is stored for each of a pair of Map processes, the relevance being a predetermined value and taking a higher value as the Map process and the other Map process have higher relevance to each other;
- and
- a processor that executes instructions to:
- accept a plurality of the Map processes;
- acquire the relevance between each pair of Map processes included in the plurality of the Map processes accepted, with reference to the process relevance information stored in the storage device;
- and
- distributively instruct a plurality of processing nodes to execute the accepted Map processes so that different processing nodes execute Map processes having high relevance, based on the acquired relevance between the pair of Map processes, wherein
- the processor performs the distributed instruction based on the acquired relevance between the pair of Map processes so that the different processing nodes execute processes in which a value of the relevance becomes high among processes to be executed, by aggregating a pair of Map processes having lowest relevance among the processes to be executed or dividing a combination in which the relevance becomes highest when combined among the processes to be executed, based on a result of calculating a processing cost required for executing the Map processes and the number of processing nodes capable of executing the Map processes.
5 more elements
A distributed processing control method comprising:
- storing, by a storage device, in a case of performing distributed processing using a MapReduce model in which a Map process for data processing and a Reduce process that uses a process result of the Map process are performed, process relevance information showing relevance between a Map process and another Map process for each of a pair of Map processes, the relevance being a predetermined value and taking a higher value as the Map process and the other Map process having higher relevance to each other;
- accepting, by a processor of a computing device, a plurality of Map processes;
- acquiring, by the processor, the relevance between each pair of Map processes included in the plurality of the Map processes accepted, with reference to the process relevance information stored in the storage device;
- and
- based on the acquired relevance between the processes, distributively instructing, by the processor, a plurality of processing nodes to execute the accepted Map processes so that different processing nodes execute Map processes having high relevance, based on the acquired relevance between the pair of Map processes, wherein
- the processor performs the distributed instruction based on the acquired relevance between the pair of Map processes so that the different processing nodes execute processes in which a value of the relevance becomes high among processes to be executed, by aggregating a pair of Map processes having lowest relevance among the processes to be executed or dividing a combination in which the relevance becomes highest when combined among the processes to be executed, based on a result of calculating a processing cost required for executing the Map processes and the number of processing nodes capable of executing the Map processes.
3 more elements
A non-transitory computer-readable medium storing a program comprising instructions for causing a distributed processing control device to perform a method comprising:
- storing, in a case of performing distributed processing using a MapReduce model in which a Map process for data processing and a Reduce process that uses a process result of the Map process are performed, process relevance information showing relevance between a Map process and another process for each of a pair of Map processes, the relevance being a predetermined value and taking a higher value as the Map process and the other Map process having higher relevance to each other;
- accepting a plurality of Map processes;
- acquiring relevance between each pair of Map processes included in the plurality of the Map processes accepted, with reference to the process relevance information stored in the storage device;
- and
- distributively instruct a plurality of processing nodes to execute the accepted Map processes so that different processing nodes execute Map processes having high relevance, based on the acquired relevance between the pair of Map processes, wherein
- the processor performs the distributed instruction based on the acquired relevance between the pair of Map processes so that the different processing nodes execute processes in which a value of the relevance becomes high among processes to be executed, by aggregating a pair of Map processes having lowest relevance among the processes to be executed or dividing a combination in which the relevance becomes highest when combined among the processes to be executed, based on a result of calculating a processing cost required for executing the Map processes and the number of processing nodes capable of executing the Map processes.
3 more elements
Dependencies are inferred from the claim text.