Method and system for capturing change of data

A computing device to synchronize data present in a target data set with data present in a source data set comprising:

• a processor to read and execute instructions stored in one or more memory elements;
• and
• the one or more memory elements storing instructions related to:
• a
• data partitioner to partition the data present in the target data set to determine a partition definition of the target data set and to partition the data present in the source data set;
• a hash calculator in communication with the data partitioner, to utilize a message digest algorithm to calculate a target message digest for the data present in one or more partitions of the target data set and to calculate a source message digest for the data present in one or more partitions of the source data set;
• a comparator in communication with the hash calculator, to compare the source message digest of at least one of the partitions of the source data set and the target message digest of a corresponding partition of the target data set;
• and
• a change data capture engine in communication with the comparator and the data partitioner,
• to repartition one or more partitions associated with the change of data in the source data set based upon a degree of modification and recalculate corresponding one or more source message digest for the repartitioned partitions,
• to determine a deviation between the source message digest and the target message digest based upon a comparison of the source message digest of a partition of the source data set and the target message digest of a corresponding partition of the target data set executed by the comparator, and
• to capture the change of data in the source data set based upon the deviation and to synchronize the target data set based upon the change of data in the source data set by
• repartitioning one or more partitions of the target data set based upon the repartitioning of the source data set and
• updating the corresponding partition of the target data set with the captured change of data.

A computer implemented method for synchronizing data present in a target data set with data present in a source data set, the method comprising:

• partitioning the data present in the target data set to determine a partition definition of the target data set, the partition definition including information about the data present in each partition of the target data set;
• calculating a target message digest for the data present in one or more partitions of the target data set;
• based upon the partition definition of the target data set, partitioning the data present in the source data set;
• calculating a source message digest for the data present in one or more partitions of the source data set;
• based upon a change of data and a degree of change of the data in the source data set, repartitioning one or more partitions associated with the change of data in the source data set and recalculating corresponding one or more source message digest for the repartitioned partitions;
• comparing the source message digest of a partition of the source data set and the target message digest of a corresponding partition of the target data set to determine a deviation between the source message digest and the target message digest;
• and
• based upon the deviation, capturing the change of data in the source data set and synchronizing the target data set with the source data set by
• repartitioning one or more partitions of the target data set based upon the repartitioning of the source data set and
• updating the corresponding partition of the target data set with the captured change of data.