Replication using deduplicated secondary copy data
AssigneeCommvault Systems, Inc.
InventorsManoj Kumar Vijayan, Joe Sabu Thyvelikkakakth Job
Life of this patent
Estimating the term…
Abstract
An information management system according to certain aspects uses backup copies or other secondary copies of production data for the purposes of replicating production data to another client. The secondary copies can be deduplicated copies. By utilizing available secondary copies of the data for replication, the system can reduce the impact on the production machines associated with replication. Utilizing deduplicated copies not only reduces the amount of stored data, but also reduces the amount of data that is communicated between the source and the destination, increasing the speed of the replication process.
Claims20
A system for replicating primary data from a source system to a destination system using secondary copy data in secondary storage, the system comprising:
- one or more source secondary storage controller computers comprising hardware, the one or more source secondary storage controller computers configured to:
- create a plurality of source deduplicated secondary copies of source primary data stored in a native format on the one or more source secondary storage devices, wherein the each of the plurality of source deduplicated secondary copies is stored in a backup format that is different than the native format;
- create a replication metadata container file that comprises first metadata associated with a first source deduplicated secondary copy and a first job identifier, the first job identifier associated with creation of the first source deduplicated secondary copy;
- reuse the replication metadata container file by storing second metadata associated with a second source deduplicated secondary copy in the replication metadata container file, the second source deduplicated secondary copy having a second job identifier associated therewith, wherein the replication metadata container file comprises the first metadata from the first source deduplicated secondary copy and the second metadata from the second source deduplicated secondary copy, wherein the replication metadata container file retains the first job identifier, and wherein reusing the replication metadata container file with the first job identifier reduces metadata storage in the source secondary storage device;
- send signature values corresponding to a plurality of deduplicated data blocks in the plurality of source deduplicated secondary copies to the one or more destination secondary storage controller computers with one or more secondary data replication streams;
- send command messages in the one or more secondary data replication streams to the one or more destination secondary storage controller computers, the command messages associated with the plurality of deduplicated data blocks, each command message having a timestamp associated therewith;
- and
- one or more destination secondary storage controller computers comprising hardware, the one or more destination secondary storage controller computers configured to:
- create replicated deduplicated secondary copy based on the plurality of deduplicated data blocks from the first deduplicated secondary copy and the embedded signature values in the one or more secondary data replication streams, the replicated deduplicated secondary copy stored on the one or more destination secondary storage devices to create at least one destination deduplicated secondary copy, the destination deduplicated secondary copy stored in the backup format on the one or more destination secondary storage devices;
- restore the destination deduplicated secondary copy in the backup format to the one or more destination primary storage devices to create a restored version of the destination deduplicated secondary copy, the restored version is in the native format of the source primary data;
- and
- apply the command messages received in the one or more secondary data replication streams to the restored version of the second deduplicated secondary copy, based on the timestamps associated with the command messages to create replicated destination primary data consistent with the source primary data based on the timestamps, the replicated destination primary data stored in the one or more destination primary storage devices in the native format of the source primary data.
A method of replicating primary data from a source system to a destination system using secondary copy data in secondary storage, the method comprising:
- creating with one or more source secondary storage controllers a plurality of source deduplicated secondary copies that are copies of source primary data on a source primary storage device, the source primary data stored in a native format and each of the plurality of source deduplicated secondary copies stored in a backup format that is different than the native format;
- creating a replication metadata container file that comprises first metadata associated with a first source deduplicated secondary copy and a first job identifier, the first job identifier associated with creation of the first source deduplication secondary copy;
- reusing the replication metadata container file by storing second metadata associated with a second source deduplicated secondary copy in the replication metadata container file, the second source deduplicated secondary copy having a second job identifier associated therewith, wherein the replication metadata container file comprises the first meta data from the first source deduplicated secondary copy, and the second metadata from the second source deduplicated secondary copy, wherein the replication metadata container file retains the first job identifier and wherein reusing the replication metadata container file with the first job identifier reduces metadata storage in the source secondary storage devices;
- sending with the one or more source secondary storage controllers signature values corresponding a plurality of deduplicated data blocks in the plurality of source deduplicated secondary copies to one or more destination secondary storage controller computers in the destination system with one or more secondary data replication streams;
- and
- send command messages in the one or more secondary data replication streams to the one or more destination secondary storage controller computer, the command messages associated with the plurality of deduplicated data blocks, each command message having a timestamp associated therewith;
- and
- receiving with one or more destination secondary storage devices the one or more secondary data replication streams comprising the plurality of deduplicated data blocks and the embedded signature values, and creating at least one replicated deduplicated secondary copy, the replicated deduplicated secondary copy stored as a destination deduplicated secondary copy in the backup format on the one or more destination secondary storage devices;
- restoring the destination deduplicated secondary copy in the backup format to one or more destination primary storage devices of the destination system to create a restored version of the destination deduplicated secondary copy in the native format of the source primary data;
- and
- applying the command messages received in the one or more secondary data replication streams to the restored version of the destination deduplicated secondary copy, based on the timestamps associated with the command messages to create replicated destination primary data consistent with the source primary data based on the timestamps, the replicated destination primary data stored in the one or more destination primary storage devices in the native format of the source primary data.
Dependencies are inferred from the claim text.