Distributed Data Scalable Adaptive Map-Reduce Framework
AssigneeInternational Business Machines Corporation
InventorsAnkur Narang, Jyothish Soman
Life of this patent
Estimating the term…
Abstract
A method for generating a distributed data scalable adaptive map-reduce framework for at least one multi-core cluster. The method includes partitioning a cluster into at least one computational group, determining at least one key-group leader within each computational group, performing a local combine operation at each computational group, performing a global combine operation at each of the at least one key-group leader within each computational group based on a result from the local combine operation, and performing a global map-reduce operation across the at least one key-group leader within each computational group.
Claims11
A method for generating a distributed data scalable adaptive map-reduce framework for at least one multi-core cluster, wherein the method comprises:
- partitioning a cluster into at least one computational group;
- determining at least one key-group leader within each computational group;
- performing a local combine operation at each computational group;
- performing a global combine operation at each of the at least one key-group leader within each computational group based on a result from the local combine operation;
- and
- performing a global map-reduce operation across the at least one key-group leader within each computational group;
- wherein at least one of the steps is carried out by a computer device.
Dependencies are inferred from the claim text.