Data reconciliation for a multi-channel pipeline

A method for data reconciliation for a target platform, comprising:

• obtaining, by a device and via a source platform, source data that is to be provided to the target platform to be stored in one or more databases included in the target platform,
• wherein the one or more databases are accessible via a multi-channel pipeline;
• providing, by the device, the source data via the multi-channel pipeline to cause input data to be provided to the target platform,
• wherein multiple channels of the multi-channel pipeline are associated with different data formats, and
• wherein the channels are configured to transform the source data and provide the transformed source data as output of the multi-channel pipeline;
• obtaining, by the device, sets of intermediate data associated with respective channels of the multiple channels included in the multi-channel pipeline;
• determining, by the device and based on a comparison of the transformed source data, the sets of intermediate data, and the input data, data reconciliation information indicating one or more data discrepancy events and channels, of the multiple channels, associated with respective data discrepancy events of the one or more data discrepancy events;
• and
• performing, by the device and based on the data reconciliation information, an action.

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

• one or more instructions that, when executed by one or more processors of a device, cause the device to:
• obtain, via a source platform, source data that is to be provided to a target platform to be stored in one or more databases included in the target platform;
• provide the source data via a multi-channel pipeline data to cause input data to be provided to the target platform,
• wherein the source data is an input of the multi-channel pipeline and the input data is an output of the multi-channel pipeline,
• wherein channels of the multi-channel pipeline are associated with different data formats, and
• wherein the channels are configured to transform the source data and provide the transformed source data as the output of the multi-channel pipeline;
• obtain sets of intermediate data associated with respective channels of multiple channels included in the multi-channel pipeline;
• compare the transformed source data, the sets of intermediate data, and the input data based on one or more data normalization operations associated with at least one of the sets of intermediate data;
• identify, based on comparing the transformed source data, the sets of intermediate data, and the input data, data reconciliation information indicating one or more data discrepancy events and channels, of the multiple channels, associated with respective data discrepancy events of the one or more data discrepancy events;
• and
• perform, based on the data reconciliation information, an action.