System and method for supporting a scalable concurrent queue in a distributed data grid

A system for providing a scalable queue in a multi-threaded processing environment, the system, comprising:

• a computer system having a memory and microprocessor capable of multithreaded operation;
• a central queue having a head, a tail, a tail reference, and an ordered plurality of nodes in said memory;
• a plurality of temporary queues each holding a batch of nodes;
• a plurality of producers configured to perform an insertion operation to insert a node into said central queue by performing the following steps,
• inserting a node into a batch of nodes in a temporary queue of the plurality of temporary queues,
• attempting to insert said batch of nodes held in said temporary queue into the central queue,
• completing said insertion operation when said batch is inserted into the central queue;
• and
• whereby nodes are inserted into said central queue in batches, thereby reducing contention on said central queue.

A non-transitory computer readable medium including instructions stored thereon for providing a scalable queue in a multi-threaded processing environment, which instructions, when executed, cause the multi-threaded processing environment to perform steps comprising:

• providing a central queue having a head, a tail, a tail reference, and an ordered plurality of nodes;
• providing a plurality of temporary queues each holding a batch of nodes;
• configuring a plurality of producers to perform an insertion operation to insert a node into said central queue by performing the following steps,
• inserting a node into a batch of nodes in a temporary queue of the plurality of temporary queues,
• attempting to insert said batch of nodes held in said temporary queue into the central queue,
• completing said insertion operation when said batch is inserted into the central queue;
• and
• whereby nodes are inserted into said central queue in batches, thereby reducing contention on said central queue.