Intelligent queuing with feedback-driven admission controls

A system, comprising:

• a computing system, comprising:
• at least one first processor;
• and
• a first non-transitory computer readable medium communicatively coupled to the at least one first processor, the first non-transitory computer readable medium having stored thereon computer software comprising a first set of instructions that, when executed by the at least one first processor, causes the computing system to:
• send, to a downstream system, first data among a plurality of data that is stored in a first queue;
• determine that the first data has not been successfully transmitted to and received by the downstream system;
• determine when the first queue is in a first state;
• analyze one of a number of successful transmission attempts and a number of unsuccessful transmission attempts within a first predetermined window, to determine that a first trigger event has occurred;
• and
• change a state of the first queue from the first state to a second state, the first and second states of the first queue defining how data is enqueued by the first queue.

A method, comprising:

• sending, by a server and to a downstream system, first data among a plurality of data that is stored in a first queue among a plurality of queues that is part of a logging system having a plurality of working threads, wherein the plurality of data comprises a plurality of low priority data;
• determining, by the server, that the first data has not been successfully transmitted to and received by the downstream system;
• determining, by the server, that the first queue is in a blocking state;
• analyzing, by the computing system, one of a number of successful transmission attempts and a number of unsuccessful transmission attempts within a first predetermined window, to determine whether a first trigger event has occurred;
• changing, by the server, a state of the first queue from the blocking state to a non-blocking state, wherein, when the first queue is full and in the blocking state, the blocking state causes second data that is subsequently received by the first queue to wait to enqueue in the first queue until the first queue is no longer full and is able to enqueue the second data, wherein, when the first queue is full and in the non-blocking state, the non-blocking state causes third data that is subsequently received by the first queue to fail to enqueue, resulting in the third data being dropped and a first queue error message being immediately sent to at least a source of the third data;
• based on a determination that the first data has been successfully received by the downstream system and when the first queue is in the non-blocking state, analyzing, by the computing system, the number of successful transmission attempts and the number of unsuccessful transmission attempts within a second predetermined window, to determine whether a second trigger event has occurred;
• and
• based on a determination that the second trigger event has occurred, changing, by the server, the state of the first queue from the non-blocking state to the blocking state.