Map reduce using coordination namespace hardware acceleration
AssigneeInternational Business Machines Corporation
InventorsPhilip Jacob, Philip Neil Strenski, Charles Johns
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorsPhilip Jacob, Philip Neil Strenski, Charles Johns
Estimating the term…
A system and method for supporting data MapReduce operations in a tuple space/coordinated namespace (CNS) extended memory storage architecture. The system-wide CNS provides an efficient means for storing and communicating data generated by local processes running at the nodes, and coordinated to provide MapReduce operations in a multi-nodal system. A hardware accelerated mechanism supports map reduce sorting/shuffle operations and reduce operations according to an aggregate function. Local processes running at a node generate a tuple corresponding to data generated by a process, each tuple having a tuple name and tuple data value corresponding to the generated data. Each tuple is processed and stored at the node or another node, dependent upon its tuple name. Tuple records associated with a tuple name are accumulated at one or more nodes according to a linked list structure at each that is accessible via a hash table index pointer at the node.
A method for mapping and reducing data generated by a plurality of processes running at one or more distributed computing nodes sharing a coordination namespace, said method comprising:
A system for mapping and reducing data generated by a plurality of processes running at one or more distributed computing nodes sharing a coordination namespace, said system comprising:
Dependencies are inferred from the claim text.