Targeted deduplication using group fingerprints and auto-generated backup recipes for virtual synthetic replication

A system making backups of protected data from a backup client for storage through a storage server, comprising:

• a storage server component group fingerprints from individual fingerprints generated for each segment of protected data divided into variable size segments and then grouped together, wherein each fingerprint comprises a signature for a respective data segment, and maintaining the group fingerprints for files resident on the storage server;
• a comparator component of the storage server comparing the group fingerprints of a file with those of other base files on the system to determine the deduplicated data between them;
• and
• a further storage server component automatically generating a recipe for the file based on this comparison identifying which base files contain duplicated data, wherein the recipe comprises a specific sequence of steps used to generate the file by synthesizing these duplicated regions;
• and using this recipe during replication process of the deduplicated backup system, and wherein the deduplicated backup system comprises a Data Domain file system (DDFS) and a Data Domain Bandwidth Optimized Open Storage Technology (DDBoost) library that links with the application to reduce bandwidth required for data ingests, and which translates application read and write request to DDBoost application program interfaces (APIs).

A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method of making backups of protected data from a backup client for storage through a storage server of a deduplicated backup system, comprising:

• generating, on a storage server, group fingerprints from individual fingerprints generated for each segment of protected data divided into variable size segments and then grouped together, wherein each fingerprint comprises a signature for a respective data segment;
• maintaining the group fingerprints for files resident on the storage server;
• comparing, in the storage server, respective group fingerprints for a file and other files on the system to determine duplicated data regions;
• automatically generating a recipe for the file based on the results of the comparing, wherein the recipe comprises a specific sequence of steps used to generate the file by synthesizing these duplicated regions;
• and
• using the recipe during replication process of the deduplicated backup system, wherein the deduplicated backup system comprises a Data Domain file system (DDFS) and a Data Domain Bandwidth Optimized Open Storage Technology (DDBoost) library that links with the application to reduce bandwidth required for data ingests, and which translates application read and write request to DDBoost application program interfaces (APIs).