Large scale data storage system with fault tolerance
AssigneeEMC Corporation
InventorsAbhishek Rajimwale, Windsor W. Hsu
Life of this patent
Estimating the term…
Abstract
According to one embodiment, a large scale data storage system with fault tolerance is described. In one example, a system includes a plurality of storage partitions, each partition including a portion of a large scale data store, and metadata corresponding to the portion of the large scale data store. At least one partition includes namespace metadata for the large scale data store including namespace data for a portion of the large scale data store outside the at least one partition.
Claims13
An apparatus comprising:
- a plurality of storage partitions, each partition including:
- a portion of a large scale data store;
- and
- metadata corresponding to the portion of the large scale data store,
- the apparatus configured to:
- select one of the plurality of storage partitions as a target partition;
- write data of a large scale data store to be backed up into an active partition, the active partition being one of the plurality of storage partitions;
- write namespace data for the large scale data store into the active partition, the namespace data including namespace data for a portion of the large scale data store outside the active partition;
- back up data from the active partition into the target partition;
- deduplicate the data written into the target partition within the partition but not across other partitions;
- seal the data written to the target partition against writing any additional data;
- select a new partition of the plurality of storage partitions that is not sealed as a new target partition;
- and
- back up new data of the large scale data store from the active partition to the new target partition.
A computer-implemented method for configuring storage partitions of a file storage system, the method comprising:
- selecting a storage partition as a target partition;
- writing data of a large scale data store to be backed up into an active partition;
- writing namespace data for the large scale data store into the active partition, the namespace data including namespace data for a portion of the large scale data store outside the active partition;
- backing up data from the active partition into the target partition;
- deduplicating the data written into the target partition within the partition but not across other partitions;
- sealing the data written to the target partition against writing any additional data;
- selecting a new partition that is not sealed as a new target partition;
- and
- backing up new data of the large scale data store from the active partition to the new target partition.
A computer-readable storage medium having instructions stored therein, which when executed by a computer, cause the computer to perform a method for configuring storage partitions of a file storage system, the method comprising:
- selecting a storage partition as a target partition;
- writing data of a large scale data store to be backed up into an active partition;
- writing namespace data for the large scale data store into the active partition, the namespace data including namespace data for a portion of the large scale data store outside the active partition;
- backing up data from the active partition into the target partition;
- deduplicating the data written into the target partition within the partition but not across other partitions;
- sealing the data written to the target partition against writing any additional data;
- selecting a new partition that is not sealed as a new target partition;
- and
- backing up new data of the large scale data store from the active partition to the new target partition.
Dependencies are inferred from the claim text.