Storing encoded data files on multiple file servers

A method for retrieving and decoding encoded data blocks of a data file from multiple file servers, the method comprising:

• retrieving a data clip size S and a number N of data clips included in each data block;
• for each encoded data block, retrieving N linearly independent encoded data clips corresponding to the data block from the multiple file servers, decoding the N linearly independent encoded data clips using one or more linear equations, and assembling the N data clips each having the data clip size S into the data block;
• and
• assembling the data blocks into the data file.

A system for encoding and storing data blocks of a data file on multiple file servers and retrieving and decoding encoded data blocks of the data file from the multiple file servers, the system comprising:

• a primary file server and one or more secondary file servers,
• the primary file server being configured, during the storing of the data file, to:
• select a data clip size S;
• select a number N of data clips to include in each data block;
• divide the data file into data blocks each having data size (S×N);
• and
• for each data block, divide the data block into N data clips, generate a random number R where 1≦R≦N, select a number K of redundant data clips where N≦K<2̂N, encode K data clips using random linear coding by XORing R data clips K times, and store the K encoded data clips on one or more secondary file servers, and
• the primary file server being further configured, during the retrieving of the data file, to:
• for each encoded data block, retrieve N linearly independent encoded data clips corresponding to the data block from the one or more secondary file servers, decode the N linearly independent encoded data clips using one or more linear equations, and assemble the N data clips each having the data clip size S into the data block;
• and
• assemble the data blocks into the data file.