Process for generating and reconstructing variable number of parity for byte streams independent of host block size

A method for generating parity in a data storage system, the method comprising the steps of:

• organizing an incoming data block into a specified number of data stripes;
• cascading the data stripes into a parity creation mechanism;
• and
• creating a specified number of parity stripes based on the data stripes, wherein the number of parity stripes in independent of the size of the data block, wherein the step of creating the parity stripes further comprises:
• reading the data stripes one at a time, wherein the data is discarded without being physically stored after it is read;
• iteratively computing each parity stripe as each data stripe is read, using an adaptable matrix of pointers;
• and
• storing the parity stripes.

A method for generating parity in a data storage system, the method comprising the steps of:

• organizing an incoming data block into a specified number of data stripes;
• cascading the data stripes into a parity creation mechanism;
• creating a specified number of parity stripes based on the data stripes, wherein the number of parity stripes is independent of the size of the data block;
• reading available data stripes and available parity stripes one at a time, wherein the data and parity are discarded without being physically stored after it is read:
• iteratively reconstruction intermediate values for each lost stripe as each available data stripe and available parity stripe is read, using an adaptable matrix of pointers;
• determining values for the reconstructed stripes by propagating corrections for the intermediate values;
• and
• storing the final values of the reconstructed stripes.

A computer program product in a computer readable medium for generating parity in a data storage system, the computer program product comprising:

• first instructions for organizing an incoming data block into a specified number of data stripes;
• second instructions for cascading the data stripes into a parity creation mechanism;
• and
• third instructions for creating a specified number of parity stripes based on the data stripes, wherein the number of parity stripes is independent of the size of the incoming data block,
• wherein the data stripes and the parity stripes can be modified at arbitrary points in the method using a parameter control at an interface to the parity creation mechanism.

A computer program product in a computer readable medium for generating parity in a data storage system, the computer program product comprising:

• first instructions for organizing an incoming data block into a specified number of data stripes;
• second instructions for cascading the data stripes into a parity creation mechanism;
• and
• third instructions for creating a specified number of parity stripes based on the data stripes, wherein the number of parity stripes is independent of the size of the incoming data block;
• fourth instructions for reading available data stripes and available parity stripes one at a time, wherein the data and parity are discarded without being physically stored after it is read;
• fifth instructions for iteratively reconstruction intermediate values for each lost stripe as each available data stripe and available parity stripe is read, using an adaptable matrix of pointers;
• sixth instructions for determining final values for the reconstructed stripes by propagating corrections for the intermediate values;
• and
• seventh instructions for storing the final values of the reconstructed stripes.