Method and apparatus for providing load diffusion in data stream correlations
AssigneeInternational Business Machines Corporation
InventorsXIAOHUI GU, Philip S. Yu
Life of this patent
Estimating the term…
Abstract
A computer implemented method, apparatus, and computer usable program code for performing load diffusion to process data stream pairs. A data stream pair is received for correlation. The data stream pair is partitioned into portions to meet correlation constraints for correlating data in the data stream pair to form a partitioned data stream pair. The partitioned data stream pair is sent to a set of nodes for correlation processing to perform the load diffusion.
Claims20
A computer implemented method for providing load diffusion to perform a join operation over a data stream pair using a distributed stream processing system, the computer implemented method comprising:
- receiving the data stream pair for correlation;
- partitioning the data stream pair using correlation constraints to form a partitioned data stream pair;
- and
- distributing the partitioned data stream pair among a set of server nodes for load diffusion in performing the join operation.
A computer program product comprising:
- a computer usable medium including computer usable program code for providing load diffusion to perform a join operation over a data stream pair using a distributed stream processing system, said computer program product including:
- computer useable code for receiving the data stream pair for correlation;
- computer usable program code for partitioning the data stream pair using correlation constraints to form a partitioned data stream pair;
- and
- computer usable program code for distributing the partitioned data stream pair among a set of server nodes for load diffusion in performing the join operation.
A data processing system comprising:
- a bus;
- a communications unit connected to the bus;
- a storage device to the bus, wherein the storage device includes computer usable program code;
- and
- a processor unit connected to the bus, wherein the processor unit executes the computer usable program code to provide load diffusion to perform a join operation over a data stream pair using a distributed stream processing system;
- receive the data stream pair for correlation;
- partition the data stream pair using correlation constraints to form a partitioned data stream pair;
- and distribute the partitioned data stream pair among a set of server nodes for load diffusion in performing the join operation.
Dependencies are inferred from the claim text.