Differential processing mechanism for spark-based graph computing background
AssigneeInternational Business Machines Corporation
InventorsJui-Hsin Lai, Lifeng Nail, Toyotaro Suzumura, Yinglong Xia
Life of this patent
Estimating the term…
Abstract
A Resilient Distributed Dataset (RDD) processing method, system, and computer program product include sending a different portion including a global identifier and different values of a message from a receiver to a sender and at a receiver side, an already-processed message is extracted from an RDD object repository corresponding to the global identifier of the different portion and the incoming differential portion is applied to the already-processed message
Claims20
A computer-implemented Resilient Distributed Dataset (RDD) processing method on a cluster environment, the method comprising:
- sending a different portion including a global identifier and a different value of a message from a receiver to a sender;
- and
- at a receiver side, an already-processed message is extracted from an RDD object repository corresponding to the global identifier of the different portion and the incoming differential portion to the receiver is applied to the already-processed message.
A computer program product for Resilient Distributed Dataset (RDD) processing on a cluster environment, the computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform:
- sending a different portion including a global identifier and different values of a message from a receiver to a sender;
- and
- at a receiver side, an already-processed message is extracted from an RDD object repository corresponding to the global identifier of the different portion and the incoming differential portion to the receiver is applied to the already-processed message.
A Resilient Distributed Dataset (RDD) processing system on a cluster environment, said system comprising:
- a processor;
- and
- a memory, the memory storing instructions to cause the processor to perform:
- sending a different portion including a global identifier and different values of a message from a receiver to a sender;
- and
- at a receiver side, an already-processed message is extracted from an RDD object repository corresponding to the global identifier of the different portion and the incoming different portion to the receiver is applied to the already-processed message.
Dependencies are inferred from the claim text.