US 11,121,727 B2 · Adaptive data storing for data storage systems employing erasure coding

Abstract

Adaptive data storing for a data storage system employing erasure coding is disclosed. Incoming data for storage can be encoded according to an erasure code scheme that can generate k coding fragments and in data fragments for each unit of incoming data. The portions of the encoded fragments resulting from the incoming data can be stored among different storage devices of data storage system. A first portion of the encoded fragments can be stored according to a first ratio. A storage system performance indicator based on the storing of the first portion can trigger an update of the first ratio, resulting in a second ratio that can be applied to storage of a second portion of the encoded fragments. The use of the disclosed variable k-to-m ratio can reduce instances of heavily burdened storage devices that can negatively impact performance of the data storage system.

Claims20

Dependent claims

A system, comprising:

a processor;
and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
in response to receiving incoming data, generating encoded data based on the incoming data according to an erasure code scheme, wherein the encoded data comprises k coding fragments of the encoded data for every m data fragments of the encoded data, wherein k is a positive integer, and wherein m is a positive integer;
causing storage of a first portion of the encoded data according to a first ratio of coding fragments to data fragments;
determining a first performance indicator value corresponding to the storage of the first portion of encoded data according to the first ratio;
in response to determining that a rule relating to the first performance indicator is satisfied, updating the first ratio, resulting in a second ratio;
and
causing storage of a second portion of the encoded data according to the second ratio.

6 more elements

A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

determining a first ratio of coding fragments to data fragments based on a first performance indicator of a storage system, wherein the coding fragments and the data fragments are comprised in encoded data to be stored in the storage system, wherein the encoded data is a representation of incoming data according to an erasure code scheme, and wherein the encoded data comprises k coding fragments of the encoded data for every m data fragments of the encoded data, wherein k is a positive integer, and wherein m is a positive integer;
storing a first portion of a first protection set of the encoded data according to the first ratio at a first storage device of the storage system, and storing a second portion of the first protection set of the encoded data at a second storage device of the storage system;
determining a first performance indicator value corresponding to the storage of the first portion of encoded data according to the first ratio;
in response to determining that a rule relating to the first performance indicator is satisfied, updating the first ratio, resulting in a second ratio that is different than the first ratio;
and
storing a third portion of a second protection set of the encoded data according to the second ratio at the first storage device, and storing a fourth portion of the second protection set of the encoded data at a third storage device of the storage system.

3 more elements

Dependencies are inferred from the claim text.

Adaptive data storing for data storage systems employing erasure coding

Life of this patent

Adaptive data storing for data storage systems employing erasure coding

Life of this patent

Abstract

Claims20