Combined garbage collection and data integrity checking for a distributed key-value store
AssigneeNetApp, Inc.
InventorsWei Sun, Mark David Olson, Anil Paul Thoppil
Life of this patent
Estimating the term…
Loading patent…
AssigneeNetApp, Inc.
InventorsWei Sun, Mark David Olson, Anil Paul Thoppil
Estimating the term…
Systems and methods are described for a streamlined garbage collection process during which data integrity checking is also performed for a distributed key-value (KV) store utilized by a distributed storage management system. According to one embodiment, by making use of full or truncated block IDs (rather than an intermediate probabilistic data structure, such as a Bloom filter) for garbage collection, data integrity checking can be performed concurrently almost for free. During garbage collection, a block ID compare list is compared to block IDs within the distributed KV store. If a particular block ID is present in the distributed KV store but is missing from the block ID compare list, the corresponding data block represents garbage to be collected. If the particular block ID is present in the block ID compare list but missing from the distributed KV store, a data integrity error has been identified.
A method for combining garbage collection and data integrity checking on a distributed KV store utilized by a cluster of a distributed storage management system, the method comprising:
A non-transitory machine readable medium storing instructions, which when executed by a processing resource of a node of a plurality of nodes of a cluster of a distributed storage management system, cause the node to:
A distributed storage management system comprising:
Dependencies are inferred from the claim text.