Fast deduplication data verification
AssigneeCommvault Systems, Inc.
InventorsSaurabh AGRAWAL, Manoj Kumar VIJAYAN
Life of this patent
Estimating the term…
Abstract
An information management system provides a data deduplication system that uses a primary table, a deduplication chunk table, and a chunk integrity table to ensure that a referenced deduplicated data block is only verified once during the data verification of a backup or other replication operation. The data deduplication system may reduce the computational and storage overhead associated with traditional data verification processes. The primary table, the deduplication chunk table, and the chunk integrity table, all of which are stored in a deduplication database, can also ensure synchronization between the deduplication database and secondary storage devices.
Claims20
A networked information management system configured to verify synchronization of deduplication information, the networked information management system comprising:
- a data storage computer comprising computer hardware configured to:
- retrieve, from an electronically stored deduplication database, a primary table, wherein the primary table identifies data blocks stored in a secondary storage device and a data chunk associated with a plurality of data blocks including the respective data block, and wherein the primary table comprises a primary identification for each identified data block;
- generate, for each data chunk identified in the primary table, a first value based on the primary identifications of the identified data blocks;
- generate, for each data chunk identified in the primary table, a second value based on the primary identifications of the identified data blocks;
- store, for each respective data chunk identified in the primary table, an identification of the respective data chunk in a deduplication chunk table;
- store, for each respective data chunk identified in the primary table, the first value associated with the respective data chunk in the deduplication chunk table;
- and
- store, for each respective data chunk identified in the primary table, the second value associated with the respective data chunk in the deduplication chunk table,
- wherein the stored first values and the stored second values allow the data storage computer to verify that information stored in the primary table and information stored in the secondary storage device is synchronized.
A computer-implemented method for verifying synchronization of deduplication information, the computer-implemented method comprising:
- retrieving, from an electronically stored deduplication database, a primary table, wherein the primary table identifies data blocks stored in a secondary storage device and a data chunk associated with the respective data block, and wherein the primary table comprises a primary identification for each identified data block;
- generating, for each data chunk identified in the primary table, a first value based on the primary identifications of the identified data blocks;
- generating, for each data chunk identified in the primary table, a second value based on the primary identifications of the identified data blocks;
- storing, for each respective data chunk identified in the primary table, an identification of the respective data chunk in a deduplication chunk table;
- storing, for each respective data chunk identified in the primary table, the first value associated with the respective data chunk in the deduplication chunk table;
- and
- storing, for each respective data chunk identified in the primary table, the second value associated with the respective data chunk in the deduplication chunk table,
- wherein the stored first values and the stored second values allow a data storage computer to verify that information stored in the primary table and information stored in the secondary storage device is synchronized.
A networked information management system configured to verify synchronization of deduplication information, the networked information management system comprising:
- a storage manager comprising computer hardware configured to receive a request to verify data in a backup;
- a deduplication database media agent comprising an electronically stored deduplication database and computer hardware configured to:
- retrieve, from the deduplication database, a primary table, wherein the primary table identifies data blocks stored in a secondary storage device and a data chunk associated with a plurality of data blocks including the respective data block, and wherein the primary table comprises a primary identification for each identified data block;
- generate, for each data chunk identified in the primary table, a first value based on the primary identifications of the identified data blocks;
- generate, for each data chunk identified in the primary table, a second value based on the primary identifications of the identified data blocks;
- store, for each respective data chunk identified in the primary table, an identification of the respective data chunk in a deduplication chunk table;
- store, for each respective data chunk identified in the primary table, the first value associated with the respective data chunk in the deduplication chunk table;
- and
- store, for each respective data chunk identified in the primary table, the second value associated with the respective data chunk in the deduplication chunk table,
- wherein the stored first values and the stored second values allow the deduplication database media to verify that information stored in the primary table and information stored in the secondary storage device is synchronized.
Dependencies are inferred from the claim text.