Data warehouse batch isolation with rollback and roll forward capacity

A system for incremental data transfer from a data source to a target data repository comprising:

• a data source configured to transmit a set of new data records;
• a system repository configured to receive and store the set of new data records;
• a server in communication with the data source and the system repository, the server configured to:
• periodically receive from the data source, a set of new data records for transmission to the target data repository, wherein the target data repository comprises a set of data records;
• generate a temporary data repository, wherein the temporary data repository has a similar configuration as the target data repository;
• periodically transmit the set of new data records from the data source to the temporary data repository;
• identify one or more dependency relationship attributes among a plurality of data records within the set of data records stored within the target data repository, the one or more dependency relationship attributes indicating that the plurality of data records are dependent on each other;
• and
• when the server identifies that a predetermined number of data records and their respective dependent data records are stored within the target data repository, merge the set of data records and the set of new data records.

A server-implemented method comprising:

• periodically merging, by a server, a set of new data records by transmitting the set of new data records from a data source to a target data repository, wherein the target data repository comprises a set of data records;
• for each time the server merges the set of new data records and the set of data records in the target data repository:
• generating, by the server, one or more files, wherein each file comprises a data table comprising a list of merged data records and their corresponding pre-merged data records, and one or more dependency relationship attributes indicating a plurality of data records within the set of new data records dependent on each other;
• storing, by the server in a second data repository, the one or more files, wherein the one or more files comprises information associated with an indication of a time of the merging of the set of new data records and the set of data records in the target data repository;
• receiving, by the server from a user device, a request to identify a first data record within the target data repository prior to the merger of the set of new data records and the set of data records in the target data repository;
• identifying, by the server, a file from the one or more files corresponding to the request within the second data repository;
• determining, by the server using the identified file, the first data record within the pre-merged data associated with request;
• and
• merging the pre-merged data records with the target data repository by transmitting, by the server to the user device, the first data record associated with the request.