Systems and methods for near real-time merging of multiple streams of data

A computer-implemented method comprising:

• receiving a first stream of first data and a second stream of second data, wherein the first data and the second data include a common field;
• and
• distributing parts of the first stream and the second stream to a plurality of servers based upon a value of the common field;
• receiving, by each of the plurality of servers, a different set of first data and a different set of second data, and wherein a specified server of the plurality of servers receives all of the first data and the second data that share the common field of a specified value;
• determining a delay distribution of the received first data and second data;
• determining a processing delay based upon the delay distribution of the first data and the delay distribution of the second data;
• determining, after the processing delay and by each of the plurality of servers, whether specific ones of the first data are to be associated with specific ones of the second data to generate attributions of the first data to the second data;
• and
• storing, by each of the plurality of servers, the attributions in a storage system, and further wherein each of the plurality of servers operates independently of the other servers.

A non-transitory computer-readable storage medium storing computer-readable instructions, comprising:

• instructions for receiving a first stream of first data and a second stream of second data, wherein the first data and the second data include a common field;
• instructions for distributing parts of the first stream and the second stream to a plurality of servers based upon a value of the common field;
• instructions for receiving, by each of the plurality of servers, a different set of first data and a different set of second data, and wherein a specified server of the plurality of servers receives all of the first data and the second data that share the common field of a specified value;
• instructions for calculating a delay distribution of the first data and second data;
• instructions for determining a processing delay based upon the delay distribution of the first data and the delay distribution of the second data, wherein a data structure associated with the first data and a data structure associated with the second data each include a time stamp;
• instructions for determining, after the processing delay and by each of the plurality of servers, whether specific ones of the first data are to be associated with specific ones of the second data to generate attributions of the first data to the second data;
• and
• instructions for storing, by each of the plurality of servers, the attributions in a storage system, and further wherein each of the plurality of servers operates independently of the other servers.