Look-Ahead Staging for Time-Travel Reconstruction

A system, comprising:

• a memory;
• and
• at least one processor coupled to the memory and configured to:
• receive a package from a source system for processing through a data pipeline, wherein the package comprises a set of changes to be committed to a target system;
• store the package in a persistent storage together with a respective package status;
• transmit the package to the data pipeline in response to the storing;
• receive a commit notification for the package from the target system in response to the transmitting;
• and
• remove the package from the persistent storage in response to receiving the commit notification for the package.

A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

• receiving a package from a source system for processing through a data pipeline, wherein the package comprises a set of changes to be committed to a target system;
• storing the package in a persistent storage together with a respective package status;
• transmitting the package to the data pipeline in response to the storing;
• receiving a commit notification for the package from the target system in response to the transmitting;
• and
• removing the package from the persistent storage in response to receiving the commit notification for the package.