US 10,592,338 B2Granted

Scale out data protection with erasure coding

AssigneeEMC IP Holding Company LLC

InventorsMikhail Danilov, Andrey Kurilov

Life of this patent

Estimating the term…

Loading patent…

Abstract

Scale out data protection with erasure coding is presented herein. Based on an initial number of storage devices determined to have been included in an initial stage of a data storage cluster, an initial protection scheme for the initial stage can determine first coding fragment(s) for data stored within the data storage cluster to facilitate a first recovery, from the initial stage, of the data using the first coding fragment(s). Further, in response to a defined number of additional storage devices being determined to have been added to the data storage cluster to generate a modified data storage cluster, the initial protection scheme can be modified to obtain a modified protection scheme that can determine, for the modified data storage cluster, second coding fragment(s) for the data to facilitate a second recovery of the data using the first coding fragment(s) and the second coding fragment(s).

Claims20

Dependent claims

A system, comprising:

a processor;
and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
based on an initial number of storage devices that have been determined to have been included in an initial stage of a data storage cluster, determining an initial protection scheme for the initial stage of the data storage cluster, wherein the initial protection scheme comprises determining a first group of coding fragments for data that has been stored within the data storage cluster to facilitate a first recovery, from the initial stage of the data storage cluster, of the data using the first group of coding fragments;
and
in response to a defined number of additional storage devices being determined to have been added to the data storage cluster to generate a modified data storage cluster, modifying the initial protection scheme to obtain a modified protection scheme for the modified data storage cluster, wherein the modified protection scheme comprises determining a second group of coding fragments, different than the first group of coding fragments, for the data to facilitate a second recovery, from the modified data storage cluster, of the data using the first group of coding fragments and the second group of coding fragments.

3 more elements

A method, comprising:

determining, by a system comprising a processor, a target protection scheme for a data storage cluster, wherein the target protection scheme corresponds to a target coding matrix for data that has been stored within the data storage cluster;
based on an initial number of storage devices that have been included in an initial stage of the data storage cluster, determining, by the system, an initial protection scheme for the initial stage of the data storage cluster comprising determining a first portion of coefficients of the target coding matrix to facilitate a first recovery, from the initial stage of the data storage cluster, of a lost portion of the data;
and
in response to determining that a defined number of additional storage devices have been added to the data storage cluster to generate a modified data storage cluster, modifying, by the system, the initial protection scheme to obtain a modified protection scheme for the modified data storage cluster, wherein the modified protection scheme comprises determining a second portion of coefficients of the target coding matrix that is different than the first portion of coefficients, and wherein the first portion of coefficients and the second portion of coefficients facilitate a second recovery, from the modified data storage cluster, of the lost portion of the data.

1 more element

A non-transitory machine-readable medium comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

determining a target protection scheme for a data storage cluster, wherein the target protection scheme corresponds to a defined upper limit of coding fragments for data that has been stored within the data storage cluster;
based on an initial number of storage devices that have been determined to have been included in an initial stage of the data storage cluster, determining an initial protection scheme for the initial stage of the data storage cluster comprising determining a first portion of the coding fragments to facilitate a first recovery, from the initial stage of the data storage cluster, of the data;
and
in response to a defined number of additional storage devices being determined to have been added to the data storage cluster to obtain a modified data storage cluster, modifying the initial protection scheme to obtain a modified protection scheme for the modified data storage cluster, wherein the modified protection scheme comprises determining a second portion of the coding fragments that is different than the first portion of the coding fragments, and wherein the first portion of the coding fragments and the second portion of the coding fragments facilitate a second recovery, from the modified data storage cluster, of the data.

1 more element

Dependencies are inferred from the claim text.

Facts

Application: 15/965,453Filed 27 Apr 2018
Published: US 2019/0332474 A131 Oct 2019
Granted: 17 Mar 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

G06F 11/1076
Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's: parity data used in redundant arrays of…
H03M 13/154
Using error location or error correction polynomials: error and erasure correction, e.g. by using the error and erasure locator or Forney polynomial
H03M 13/373
Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35: with erasure…
G06F
Computing and data processing