Method to check file data integrity and report inconsistencies with bulk data movement

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations comprising:

• resuming, by a data seeding module, a suspended process for migrating data from a source tier to a target tier, wherein the data corresponds to a plurality of data segments in a plurality of containers;
• loading, by the data seeding module, a vector in memory, wherein the vector represents data segments in the plurality of containers;
• resetting, in the vector, a bit corresponding to a fingerprint for each data segment that has been copied to the target tier;
• determining that a checksum of the vector is non-zero after the data seeding module completes copying data segments in plurality of containers;
• and
• repeating the loading, the copying and the determining operations in response to determining that the checksum is non-zero.

A data processing system, comprising:

• a processor;
• a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations, the operations comprising:
• resuming, by a data seeding module, a suspended process for migrating data from a source tier to a target tier, wherein the data corresponds to a plurality of data segments in a plurality of containers;
• loading, by the data seeding module, a vector in memory, wherein the vector represents data segments in the plurality of containers;
• resetting, in the vector, a bit corresponding to a fingerprint for each data segment that has been copied to the target tier;
• determining that a checksum of the vector is non-zero after the data seeding module completes copying data segments in plurality of containers;
• and
• repeating the loading, the copying and the determining operations in response to determining that the checksum is non-zero.