Systems and methods for micro-batch processing of data

A method for micro-batch processing of data, the method comprising:

• receiving the data conveying information pertaining to operation of client computing platforms;
• for a general time duration, adding the data to a general queue;
• processing the data in the general queue in memory in accordance with a general job;
• for one or more specific time durations, adding the data to one or more specific queues based on the client computing platform to which the data pertains, the data including first data pertaining to a first client computing platform and the one or more specific queues including a first specific queue corresponding to the first client computing platform, wherein adding the data to the one or more specific queues includes adding the first data to the first specific queue for a first specific time duration;
• processing the data in the one or more specific queues in memory in accordance with one or more specific jobs, wherein processing the data in the one or more specific queues includes processing the first data in accordance with a first specific job;
• detecting an error in processing the data in accordance with the general job or the one or more specific jobs;
• and
• responsive to detection of the error, adding the data corresponding to the detected error to a skip queue.

A system for micro-batch processing, the system comprising:

• one or more physical processors configured by machine readable instruction to:
• receive data conveying information pertaining to operation of client computing platforms
• for a general time duration, add the data to a general queue;
• process the data in the general queue in memory in accordance with a general job;
• for one or more specific time durations, add the data to one or more specific queues based on the client computing platform to which the data pertains, the data including first data pertaining to a first client computing platform and the one or more specific queues including a first specific queue corresponding to the first client computing platform, wherein adding the data to the one or more specific queues includes adding the first data to the first specific queue for a first specific time duration;
• process the data in the one or more specific queues in memory in accordance with one or more specific jobs, wherein processing the data in the one or more specific queues includes processing the first data in accordance with a first specific job;
• detect an error in processing the data in accordance with the general job or the one or more specific jobs;
• responsive to detection of the error, add the data corresponding to the detected error to a skip queue;
• generate a notification based on the detection of the error in processing the data in accordance with the general job or the one or more specific jobs;
• provide access to the skip queue such that the data corresponding to the detected error is assessable via a skip queue query
• detect an unavailability of the general job or the one or more specific jobs to process the data;
• and
• responsive to detection of the unavailability of the general job or the one or more specific jobs to process the data, add the data corresponding to the detected unavailability to a retry queue.