Sub-cluster recovery using a partition group index

An apparatus comprising:

• at least one processor;
• at least one memory coupled with the at least one processor;
• and
• instructions stored in the at least one memory and executable by the at least one processor to cause the apparatus to:
• create a partition group index that performs an indexing of a set of data items into a plurality of partition groups;
• deduplicate, concurrently with the indexing, the set of data items stored in a node of a plurality of nodes into a set of deduplicated data items comprising singular copies of each data item of the set of data items, wherein a partition group of the plurality of partition groups corresponds to a node of a first plurality of nodes and comprises a subset of data items of the set of deduplicated data items of the set of deduplicated data items stored in the node;
• format the set of deduplicated data items into a recovery file in accordance with the partition group index;
• and
• load the set of deduplicated data items included in the recovery file onto a second plurality of nodes that are configured to restore the set of deduplicated data items in accordance with the partition group index.

A non-transitory computer-readable medium storing code, the code comprising instructions executable by at least one processor to:

• create a partition group index that performs an indexing of a set of data items into a plurality of partition groups;
• deduplicate, concurrently with the indexing, the set of data items stored in a node of a plurality of nodes into a set of deduplicated data items comprising singular copies of each data item of the set of data items, wherein a partition group of the plurality of partition groups corresponds to a node of a first plurality of nodes and comprises a subset of data items of the set of deduplicated data items stored in the node;
• format the set of deduplicated data items into a recovery file in accordance with the partition group index;
• and
• load the set of deduplicated data items included in the recovery file onto a second plurality of nodes that are configured to restore the set of deduplicated data items in accordance with the partition group index.