Sub-cluster recovery using a partition group index
AssigneeRubrik, Inc.
InventorsRohit Shekhar, Hyo Jun Kim, Prasenjit Sarkar, Maohua Lu, Ajaykrishna Raghavan, Pin Zhou
Life of this patent
Estimating the term…
Abstract
Embodiments disclosed herein provide systems, methods, and computer readable media for sub-cluster recovery in a data storage environment having a plurality of storage nodes. In a particular embodiment, the method provides scanning data items in the plurality of nodes. While scanning, the method further provides indexing the data items into an index of a plurality of partition groups. Each partition group includes data items owned by a particular one of the plurality of storage nodes. The method then provides storing the index.
Claims21
A method for sub-cluster recovery in a data storage environment having a plurality of nodes, the method comprising:
- scanning data items stored in the first plurality of nodes of a first cluster;
- while scanning, creating a partition group index, the partition group index indexing the data items into a plurality of partition groups, each partition group corresponding to a node of the first plurality of nodes and comprising a subset of data items stored in the node;
- storing the index;
- and
- instantiating a second cluster using a second plurality of nodes different, in number of nodes, from the first plurality of nodes, each node of the second plurality nodes being instantiated with data from at least one of the partition groups, the instantiating of the second cluster comprising for each node of the second plurality of nodes, generating per node data based on the mappings between the partition groups and the first plurality of nodes.
A system for sub-cluster recovery in a data storage environment having a plurality of nodes, the system comprising:
- one or more non-transitory computer readable storage media;
- a processing system operatively coupled with the one or more computer readable storage media;
- and
- program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system;
- direct the processing system to perform operations comprising:
- scanning data items stored in the first plurality of nodes of a first cluster;
- while scanning, creating a partition group index, the partition group index indexing the data items into a plurality of partition groups, each partition group corresponding to a node of the first plurality of nodes and comprising a subset of data items stored in the node;
- storing the index;
- and
- instantiating a second cluster using a second plurality of nodes different;
- in number of nodes, from the first plurality of nodes, each node of the second plurality nodes being instantiated with data from at least one of the partition groups, the instantiating of the second cluster comprising for each node of the second plurality of nodes, generating per node data based on the mappings between the partition groups and the first plurality of nodes.
A method for sub-cluster recovery in a data storage environment having a plurality of nodes, the method comprising:
- scanning data items stored in the first plurality of nodes of a first cluster;
- while scanning, creating a partition group index, the partition group index indexing the data items into a plurality of partition groups, each partition group corresponding to a node of the first plurality of nodes and comprising a subset of data items stored in the node;
- storing the index;
- and
- instantiating a second cluster using a second plurality of nodes different, in number of nodes, from the first plurality of nodes, each node of the second plurality nodes being instantiated with data from at least one of the partition groups, the second plurality of nodes including less nodes than the first plurality of nodes, the instantiating of the second cluster comprising generating a partition group to node mapping for the second cluster from the partition group index.
A system for sub-cluster recover in a data storage environment having a plurality of nodes, the system comprising:
- one or more non-transitory computer readable storage media;
- a processing system operatively coupled with the one or more computer readable storage media;
- and
- program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to perform operations comprising:
- scanning data items stored in the first plurality of nodes of a first cluster;
- while scanning, creating a partition group index, the partition group index indexing the data items into a plurality of partition groups, each partition group corresponding to a node of the first plurality of nodes and comprising a subset of data items stored in the node;
- storing the index;
- and
- instantiating a second cluster using a second plurality of nodes different, in number of nodes, from the first plurality of nodes, each node of the second plurality nodes being instantiated with data from at least one of the partition groups, the second plurality of nodes including less nodes than the first plurality of nodes, the instantiating of the second cluster comprising generating a partition group to node mapping for the second cluster from the partition group index.
A method for sub-cluster recovery in a data storage environment having a plurality of nodes, the method comprising:
- scanning data items stored in the first plurality of nodes of a first cluster;
- while scanning, creating a partition group index and simultaneously identifying duplicate data items in the cluster;
- indexing the data items into a plurality of partition groups, each partition group corresponding to a node of the first plurality of nodes and comprising a subset of data items stored in the node;
- storing the index;
- deduplicating the duplicate data items;
- repackaging each of the duplicate data items into respective deduplicated data units, wherein a deduplicated data unit comprises a data form that includes a single instance of a deduplicated data item and information corresponding to a location from which the deduplicated data item originated;
- storing the deduplicated data units to a secondary data repository;
- and
- instantiating a second cluster using a second plurality of nodes different, in number of nodes, from the first plurality of nodes, each node of the second plurality nodes being instantiated with data from at least one of the partition groups, the second plurality of nodes including less nodes than the first plurality of nodes, the instantiating of the second cluster comprising generating a partition group to node mapping for the second cluster from the partition group index.
Dependencies are inferred from the claim text.