Techniques for improved erasure coding in distributed storage systems

A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process, the process comprising:

• distributing a plurality of data chunks according to an erasure coding scheme, wherein the plurality of data chunks includes systematic data chunks and parity chunks that are distributed as a plurality of rows and a plurality of columns, wherein each column of the plurality of columns corresponds to an NVM node of a plurality of non-volatile memory (NVM) nodes, wherein each row of the plurality of rows includes a first parity chunk including a first function of systematic data chunks of the row, and at least one second parity chunk that includes a second function of the systematic data chunks included in the row and of at least one extra data chunk included in at least one other row;
• wherein different rows include second parity chunks that are functions of different extra data chunks;
• and
• determining for each data chunk included in a first portion of the plurality of data chunks, whether the data chunk is to be used as an extra data chunk, wherein the determining includes utilizing a formula that is based at least on a row index of the data chunk and a number of parity chunks per row.

A system for erasure coding, comprising:

• a processing circuitry;
• and
• a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to:
• distribute a plurality of data chunks according to an erasure coding scheme, wherein the plurality of data chunks includes systematic data chunks and parity chunks that are distributed as a plurality of rows and a plurality of columns, wherein each column of the plurality of columns corresponds to an NVM node of a plurality of non-volatile memory (NVM) nodes, wherein each row of the plurality of rows includes a first parity chunk including a first function of systematic data chunks of the row, and at least one second parity chunk that includes a second function of the systematic data chunks included in the row and of at least one extra data chunk included in at least one other row, wherein different rows include second parity chunks that are functions of different extra data chunks;
• and
• determine for each data chunk included in a first portion of the plurality of data chunks, whether the data chunk is to be used as an extra data chunk, wherein the determination includes utilizing a formula that is based at least on a row index of the data chunk and a number of parity chunks per row.