Systems and methods for tracking of data records

A computer implemented system for tracking a data object in a data pipeline, the system comprising:

• a memory having processor-readable instructions stored therein;
• and
• at least one processor configured to access the memory and execute the processor-readable instructions to perform operations including:
• determining a first tracking stamp for a data object from a data source, the data object indicating an occurrence of an information technology event, the first tracking stamp including a record number assigned by a first component;
• broadcasting the first tracking stamp to a channel of a record tracking queue;
• initiating a record in the record tracking queue for the data object, the record including a record number for the data object, and at least one of a station array, a station code, of a timestamp array, wherein the first tracking stamp updates the at least one of the station array, station code, or timestamp array;
• broadcasting a second tracking stamp for the data object to the channel, the second tracking stamp including the record number;
• updating the record with the second tracking stamp to indicate that the data object was received by a second component;
• determining that the data object was not received at a component downstream of the first component and the second component, based on information for the data object in the record tracking queue indicating that the data object was transferred to the second component without receipt by the downstream component;
• and
• resending the data object from the second component to the downstream component, thereby improving operation of the data pipeline.

A non-transitory computer readable medium configured to store processor-readable instructions which, when executed by at least one processor, cause the at least one processor to perform operations in a data pipeline including:

• determining a first tracking stamp for a data object from a data source, the data object indicating an occurrence of an information technology event, the first tracking stamp including a record number assigned by a first component;
• broadcasting the first tracking stamp to a channel of a record tracking queue;
• initiating a record in the record tracking queue for the data object, the record including a record number for the data object, and at least one of a station array, a station code, of a timestamp array, wherein the first tracking stamp updates the at least one of the station array, station code, or timestamp array;
• broadcasting a second tracking stamp for the data object to the channel, the second tracking stamp including the record number;
• updating the record with the second tracking stamp to indicate that the data object was received by a second component;
• determining that the data object was not received at a component downstream of the first component and the second component, based on information for the data object in the record tracking queue indicating that the data object was transferred to the second component without receipt by the downstream component;
• and
• resending the data object from the second component to the downstream component, thereby improving operation of the data pipeline.