Packing deduplicated data into finite-sized containers

A system for rehydrating deduplicated data, by packing the deduplicated data into a plurality of finite-sized containers in a computing environment, comprising:

• a processor device, operable in the computing environment, wherein the at least one processor device performs each of:
• calculating a similarity score between a plurality of similarly compared files of the deduplicated data, the similarity score indicating an overall deduplication ratio between the similarly compared files of the deduplicated data, wherein calculating the similarity score further includes calculating an nth percentage threshold of common data intersections shared between the plurality of similarly compared files of the deduplicated data, and wherein a transitive closure between the plurality of similarly compared files of the deduplicated data is determined,
• using the similarity score for grouping the plurality of similarly compared files
• of the deduplicated data into subsets for destaging each of the subsets from a deduplication system to one of the plurality of finite-sized containers, wherein a sum a data space of all of the plurality of the plurality of finite-sized containers is substantially equal to the overall deduplication ratio,
• receiving an indication by a user which of the plurality of similarly compared
• files are to be grouped into the subsets for destaging each of the subsets from a deduplication system to one of the plurality of finite-sized containers,
• using the transitive closures for assisting with using the similarity score for
• grouping the plurality of similarly compared files of the deduplicated data into the subsets;
• calculating a storage metric value by traversing the each of the subsets for
• determining a required storage space in one of the plurality of finite-sized containers, wherein the storage metric value is an upper bound of a maximum amount of storage space each respective subset would require for storing in the one of the plurality of finite-sized containers were incidental deduplicated data identified between the respective subset and alternative ones of the subsets not accounted for;
• and
• maintaining in a file similarity index an identify of each of the plurality of
• similarly compared files and the similarity score calculated for each of the plurality of similarly compared files.

A computer program product for rehydrating deduplicated data, by packing the deduplicated data into a plurality of finite-sized containers by a processor device, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

• an executable portion for calculating a similarity score between a plurality of similarly compared files of the deduplicated data, the similarity score indicating an overall deduplication ratio between the similarly compared files of the deduplicated data, wherein calculating the similarity score further includes calculating an nth percentage threshold of common data intersections shared between the plurality of similarly compared files of the deduplicated data, and wherein a transitive closure between the plurality of similarly compared files of the deduplicated data is determined;
• an executable portion for using the similarity score for grouping the plurality of similarly compared files of the deduplicated data into subsets for destaging each of the subsets from a deduplication system to one of the plurality of finite-sized containers, wherein a sum a data space of all of the plurality of the plurality of finite-sized containers is substantially equal to the overall deduplication ratio;
• an executable portion for receiving an indication by a user which of the plurality of similarly corn pared files are to be grouped into the subsets for destaging each of the subsets from a deduplication system to one of the plurality of finite-sized containers;
• an executable portion for using the transitive closures for assisting with using the similarity score for grouping the plurality of similarly corn pared files of the deduplicated data into the subsets;
• an executable portion for calculating a storage metric value by traversing the each of the subsets for determining a required storage space in one of the plurality of finite-sized containers, wherein the storage metric value is an upper bound of a maximum amount of storage space each respective subset would require for storing in the one of the plurality of finite-sized containers were incidental deduplicated data identified between the respective subset and alternative ones of the subsets not accounted for;
• and
• an executable portion for maintaining in a file similarity index an identify of each of the plurality of similarly compared files and the similarity score calculated for each of the plurality of similarly compared files.