Systems for storing files in a distributed environment
AssigneeRed Lambda, Inc.
InventorsRobert Bird, Matthew Whitlock
Life of this patent
Estimating the term…
Abstract
A system and method for storing data-files stored on distributed devices connected to a network. Data-elements of the data-files are allocated to data-blocks stored on the distributed devices. Key-identifiers are calculated for each of the data-blocks based on the allocated data-elements. The key-identifiers are stored in distributed tables stored on the distributed devices. Index-nodes are generated for the data-files based on the data-blocks. A Paxos algorithm is executed for the index-nodes based on the key-identifiers to provide a consensus of the data-files that are stored on the plurality of distributed devices.
Claims27
A system for storing data, comprising:
- data-blocks stored on a plurality of distributed devices, wherein each one of the plurality of distributed devices comprises a processor, the plurality of distributed devices are adapted to be connected via a network, the plurality of distributed devices store data-files, the data-files comprising data-elements;
- the stored data-elements are allocated via the processors to the data-blocks;
- key-identifiers calculated for each of the data-blocks, the key-identifiers are based on the allocated data-elements of the corresponding data-blocks;
- distributed tables that store the key-identifiers, the distributed tables are stored on the plurality of distributed devices;
- index-nodes for the data-files generated based on the data-blocks, the index-nodes comprising a list of the data-blocks, the index-nodes are stored in a metadata-store;
- and,
- a Paxos algorithm executed for the index-nodes based on the key-identifiers to provide a consensus of the data-files that are stored on the plurality of distributed devices.
A non-transitory computer readable medium having computer readable instructions stored thereon for execution by a processor, wherein the instructions on the non-transitory computer readable medium are adapted to:
- allocating data-elements of stored data-files to data-blocks, wherein the stored data-files are stored on a plurality of distributed devices, wherein the plurality of distributed devices are connected to a network, wherein the data-blocks are stored on the plurality of distributed devices;
- calculating key-identifiers for each of the data-blocks, wherein the key-identifiers are based on the allocated data-elements of the corresponding data-blocks;
- storing the key-identifiers in distributed tables, wherein the distributed tables are stored on the plurality of distributed devices;
- generating index-nodes for the data-files based on the data-blocks, wherein the index-nodes comprise a list of the data-blocks, wherein the index-nodes are stored in a metadata-store;
- and,
- executing a Paxos algorithm for the index-nodes based on the key-identifiers to provide a consensus of the data-files that are stored on the plurality of distributed devices.
Dependencies are inferred from the claim text.