Versioned progressive chunked queue for a scalable multi-producer and multi-consumer queue

A system comprising:

• a memory configured to store a plurality of memory chunks;
• at least one processor configured to execute a plurality of producer threads and a plurality of consumer threads, wherein a producer thread of the plurality of producer threads is configured to:
• receive an offer request associated with an item,
• responsive to receiving the offer request, increase a sequence,
• determine (i) a chunk identifier, associated with the sequence, of a memory chunk from a pool of memory chunks and (ii) a first slot position, from the sequence, in the memory chunk to offer the item, and
• write the item into the memory chunk at the first slot position;
• wherein a first consumer thread of the plurality of consumer threads is configured to:
• consume the item at the first slot position;
• and
• wherein a second consumer thread of the plurality of consumer threads is configured to:
• consume another item at a second slot position in the memory chunk,
• determine that the memory chunk is recyclable, and
• recycle the memory chunk.

A method comprising:

• receiving, by a consumer thread of a plurality of consumer threads, a consume request associated with an element;
• responsive to receiving the consume request, reading, by the consumer thread, a consumer sequence and a consumer buffer;
• extracting, by the consumer thread, (i) a chunk identifier, associated with the consumer sequence and (ii) a slot position in a memory chunk from the consumer sequence;
• determining, by the consumer thread, that a position of the element mismatches the slot position in the memory chunk from the consumer sequence;
• determining, by the consumer thread, that the memory chunk is recyclable;
• increasing, by the consumer thread, the consumer sequence;
• and
• consuming, by the consumer thread, the element at the slot position.