Low Latency Queuing System

A method for processing network traffic by a queuing system having a plurality of computing devices, each computing device having a plurality of cores, each core having an associated processing thread configured to receive network traffic, the method comprising:

• receiving, by a first processing thread associated with a first core of the plurality of cores of a first computing device of the plurality of computing devices, pointers to chunks of memory allocated responsive to a receipt of network traffic by an electronic communications unit, the chunks of memory each including a portion of a queue batch transmitted to the first computing device, wherein the queue batch includes a plurality of queue requests;
• generating a data structure including the pointers and a reference count;
• determining, for a first queue request of the plurality of queue requests, a processing assignment to a second core of the plurality of cores of the first computing device;
• generating a first structured message for the first queue request;
• and
• storing the first structured message in a structured message passing queue associated with the second core, wherein a second processing thread associated with the second core, responsive to receiving the structured message, processes the first queue request by retrieving the first queue request from at least one of the chunks of memory.

An apparatus comprising:

• a memory;
• and
• a processor having a first core and a second core, the first core configured to execute instructions stored in the memory to:
• receive pointers to chunks of memory allocated in the memory responsive to a receipt of network traffic by an electronic communications unit, the chunks of memory each including a portion of a queue batch transmitted to the electronic communications unit, wherein the queue batch includes a plurality of queue requests;
• generate a data structure including the pointers and a reference count;
• determine, for a first queue request of the plurality of queue requests, a processing assignment to the second core;
• generate a first structured message for the first queue request;
• and
• store the first structured message in a structured message passing queue in the memory, wherein the second core, responsive to reading the first structured message, processes the first queue request by retrieving the first queue request from at least one of the chunks of memory.