Mapping and reducing
AssigneeInternational Business Machines Corporation
InventorsMuhammad Sohaib Aslam, Tiia J. Salo
Life of this patent
Estimating the term…
Abstract
As disclosed herein, a method for conducting mapping and reducing operations includes receiving a plurality of data records and aggregating data records having a common value for a selected field within the data records to provide aggregated data records for each common value, storing the aggregated data records on a shared storage subsystem, and accessing the aggregated data records on the shared storage subsystem. The method further comprises accumulating information for the aggregated data records to provide accumulated information, and using the accumulated information.
Claims6
A method for optimizing data communications between servers, the method comprising:
- receiving, by a task tracker, a control information comprising a storage pointer of a location of aggregated data records via a first communication pathway from a first server, wherein the aggregated data records are stored on a shared storage subsystem by the first server via a second communication pathway;
- transmitting, by the task tracker, the storage pointer to a second server via the first communication pathway;
- and
- transmitting, by the task tracker, a notification to the second server indicating that the aggregated data is ready for use and for the second server to retrieve the data from the shared storage subsystem via the second communication pathway.
Dependencies are inferred from the claim text.