US 10,374,637 B1 · System and method for unbalanced load handling with distributed erasure coding

Abstract

A method for creating distributed erasure coding chunks in a distributed storage system with unbalanced load is disclosed. The operations comprise configuring the distributed storage system into at least k+m zones, wherein each zone accumulates at least l primary backup chunks of original data chunks replicated from different remote zones, and wherein l<k, and preparing the distributed storage system for recovery from a failure of 1 to m zones of the at least k+m zones including, in each zone, encoding the at least l primary backup chunks to create m coding chunks using an erasure coding having parameters k+m, wherein in each zone in which fewer than k primary backup chunks have been accumulated, at most k−l predetermined virtual chunks are used to create partial coding chunks.

Claims18

Dependent claims

A method for creating distributed erasure coding chunks in a distributed storage system with unbalanced load, comprising:

configuring the distributed storage system into at least k+m zones, wherein each zone accumulates at least l primary backup chunks of original data chunks replicated from different remote zones, and wherein l<k, and
preparing the distributed storage system for recovery from a failure of 1 to m zones of the at least k+m zones including, in each zone, encoding the at least l primary backup chunks to create m coding chunks using an erasure coding having parameters k+m, wherein in each zone in which fewer than k primary backup chunks have been accumulated, at most k−l predetermined virtual chunks are used to create partial coding chunks.

A non-transitory machine-readable medium having instructions stored therein which, when executed by a processor, cause the processor to perform storage operations, the operations comprising:

configuring a distributed storage system into at least k+m zones, wherein each zone accumulates at least l primary backup chunks of original data chunks replicated from different remote zones, and wherein l<k, and
preparing the distributed storage system for recovery from a failure of 1 to m zones of the at least k+m zones including, in each zone, encoding the at least l primary backup chunks to create m coding chunks using an erasure coding having parameters k+m, wherein in each zone in which fewer than k primary backup chunks have been accumulated, at most k−l predetermined virtual chunks are used to create partial coding chunks.

A data processing system, comprising:

a processor;
and
a memory coupled to the processor storing instructions which, when executed by the processor, cause the processor to perform storage operations, the operations including
configuring a distributed storage system into at least k+m zones, wherein each zone accumulates at least l primary backup chunks of original data chunks replicated from different remote zones, and wherein l<k, and
preparing the distributed storage system for recovery from a failure of 1 to m zones of the at least k+m zones including, in each zone, encoding the at least l primary backup chunks to create m coding chunks using an erasure coding having parameters k+m, wherein in each zone in which fewer than k primary backup chunks have been accumulated, at most k−1 predetermined virtual chunks are used to create partial coding chunks.

2 more elements

Dependencies are inferred from the claim text.

System and method for unbalanced load handling with distributed erasure coding

Life of this patent

System and method for unbalanced load handling with distributed erasure coding

Life of this patent

Abstract

Claims18