Systems and methods for storing and transferring message data

A system comprising:

• a non-transitory computer readable medium having instructions stored thereon;
• and
• a data processing apparatus configured to execute the instructions to perform operations comprising:
• providing a queue comprising an ordered plurality of storage blocks, each storage block storing one or more respective messages and being associated with a respective time, wherein the times increase from a block designating a head of the queue to a block designating a tail of the queue;
• reading, by each of a plurality of first sender processes, messages from one or more blocks in the queue beginning at the head of the queue;
• sending, by each of the plurality of first sender processes, the read messages to a respective recipient;
• designating as old one or more of the blocks having associated times that are earlier than a first time;
• designating a block associated with a time later than or equal to the first time as a new head of the queue;
• allowing one or more of the first sender processes to read messages from the old blocks until a second time which is later than the first time;
• and
• deleting from the queue one or more of the old blocks at a time later than or equal to the second time.

A computer program product stored in one or more non-transitory storage media for controlling a processing mode of a data processing apparatus, the computer program product being executable by the data processing apparatus to cause the data processing apparatus to perform operations comprising:

• providing a queue comprising an ordered plurality of storage blocks, each storage block storing one or more respective messages and being associated with a respective time, wherein the times increase from a block designating a head of the queue to a block designating a tail of the queue;
• reading, by each of a plurality of first sender processes, messages from one or more blocks in the queue beginning at the head of the queue;
• sending, by each of the plurality of first sender processes, the read messages to a respective recipient;
• designating as old one or more of the blocks having associated times that are earlier than a first time;
• designating a block associated with a time later than or equal to the first time as a new head of the queue;
• allowing one or more of the first sender processes to read messages from the old blocks until a second time which is later than the first time;
• and
• deleting from the queue one or more of the old blocks at a time later than or equal to the second time.