Method of data storing and maintenance in a distributed data storage system and corresponding device
AssigneeThomson Licensing
InventorsAnne-Marie Kermarrec, Erwan Le Merrer, Gilles Straub, Alexandre Van Kempen
Life of this patent
Estimating the term…
Abstract
The present invention generally relates to distributed data storage systems. In particular, the present invention is related to a method of data storing in a distributed data storage system that comprises a clustering of data blocks and the use of random linear combinations of data blocks that makes the distributed data store system efficient in terms of storage space needed and inter-device communication costs, both for the storage method, as for the associated repair method.
Claims5
A method of storing data files in a distributed data storage system comprising storage devices interconnected in a network, wherein said method comprises the following steps, executed for each data file of said data files, to store in said distributed data storage system:
- splitting said data file in k data blocks, and creation of at least n encoded data blocks from said k data blocks through random linear combination of said k data blocks;
- storing said at least n encoded data blocks by spreading said at least n encoded data blocks of said data file over at least n storage devices that are part of a same storage device cluster, each cluster comprising a distinct set of storage devices, said at least n encoded data blocks of said data file being distributed over said at least n storage devices of a storage device cluster so that each storage device cluster stores encoded data blocks from at least two different data files, and that each of said storage devices of a storage device cluster stores encoded data blocks from at least two different data files.
A device for management of storing of data files in a distributed data storage system comprising storage devices interconnected in a network, wherein the device comprises:
- a data splitter for splitting the data file in k data blocks, and for creation of at least n encoded data blocks from these said k data blocks through random linear combination of said k data blocks;
- a storage distributor for storing said at least n encoded data blocks by spreading said at least n encoded data blocks of said data file over at least n storage devices that are part of a same storage device cluster, each cluster comprising a distinct set of storage devices, said at least n encoded data blocks of said data file being distributed over the at least n storage devices of a storage device cluster so that each storage device cluster stores encoded data blocks from at least two different data files, and that each of said storage devices of a storage device cluster stores encoded data blocks from at least two different data files.
Dependencies are inferred from the claim text.