Distributed threaded streaming platform reader

A computer implemented method comprising:

• receiving, by a first plurality of processing threads executing on a processor from a streaming platform, a continuously streamed plurality of messages from each partition of a plurality of partitions or an end of signal if the partition is empty, the plurality of partitions configured to store, as they are received by the streaming platform, a plurality of messages transmitted to the streaming platform by any of a plurality of data producer systems, wherein each message of the plurality of messages includes a message content augmented with data associated with a unique sequential identifier based on when each message of the plurality of messages was transmitted by the respective one of the plurality of data producer systems relative to when other messages of the plurality of messages were transmitted by the plurality of data producer systems, the processor further configured to store, in a vector of queues, each associated with one of the plurality of partitions, in the memory based on the unique sequential identifier, the received continuously streamed plurality of messages or the end of partition signal in a time ordered sequence from an earliest message to a most recent message based on the unique sequential identifier, the earliest message of which being stored in a first position of a respective queue of the vector of queues;
• and
• forwarding, continuously by a second processing thread executing on the processor independent of the plurality of first processing threads, to a receiver in an order in accordance with the time ordered sequence defined by the unique sequential identifier associated therewith, the message content from the earliest message associated with the unique sequential identifier of the plurality of messages stored in the first position of each queue of the vector of queues.

A computer system comprising:

• means for receiving, from a streaming platform, a continuously streamed plurality of messages from each partition of a plurality of partitions or an end of signal if the partition is empty, the plurality of partitions configured to store, as they are received by the streaming platform, a plurality of messages transmitted to the streaming platform by any of a plurality of data producer systems, wherein each message of the plurality of messages includes a message content augmented with data associated with a unique sequential identifier based on when each message of the plurality of messages was transmitted by the respective one of the plurality of data producer systems relative to when other messages of the plurality of messages were transmitted by the plurality of data producer systems, the processor further configured to store, in a vector of queues, each associated with one of the plurality of partitions, in the memory based on the unique sequential identifier, the received continuously streamed plurality of messages or the end of partition signal in a time ordered sequence from an earliest message to a most recent message based on the unique sequential identifier, the earliest message of which being stored in a first position of a respective queue of the vector of queues;
• and
• means for forwarding, continuously, to a receiver in an order in accordance with the time ordered sequence defined by the unique sequential identifier associated therewith, the message content from the earliest message associated with the unique sequential identifier of the plurality of messages stored in the first position of each queue of the vector of queues.