Systems and methods for providing a distributed file system incorporating a virtual hot spare

A virtual hot spare useful in the event of a loss of data comprising:

• a plurality of storage devices that work together as a single data storage system;
• a storage allocation module configured to write incoming data across at least two of said plurality of storage devices;
• a failure recovery module configured to recreate lost data, said failure recovery module in communication with said storage allocation module;
• wherein said storage allocation module is configured to locate unallocated free space among said plurality of storage units;
• and
• wherein said unallocated free space is open for use to write incoming protected data and to write said recreated data received from said failure recovery module;
• wherein said storage allocation module is further configured to estimate the amount of parity protected data that can be written to said unallocated free space so as to leave sufficient storage space in said unallocated free space for said recreated data.

A system for storing data which dynamically provides for space to store recreated data when data is lost comprising:

• a plurality of data storage units;
• a module in communication with said data storage units to route queries to and receive responses from any one or more of said data storage units;
• said plurality of data storage units collectively having free space which is not currently allocated and which is available for use to store data of sufficient value that error correction is desirable for such data;
• a storage allocation module configured to allocate space in said free space for storage of recreated data lost due to a malfunction in the data storage system, wherein the storage allocation module is configured to receive information from the data storage units relating to performance and use this information to dynamically adjust the allocation of free space for storing incoming data in order to comply with defined system parameters including the need for free space to store recreated data in the event of a malfunction resulting in a loss of data.