Techniques for improving deduplication efficiency in a storage system with multiple storage nodes
AssigneeInternational Business Machines Corporation
InventorsNIKOLAS IOANNOU, IOANNIS KOLTSIDAS, ROMAN A. PLETKA, CHENG-CHUNG SONG, RADU STOICA, SASA TOMIC, ANDREW D. WALLS
Life of this patent
Estimating the term…
Abstract
Techniques for selecting a storage node of a storage system to store data include applying a first function to at least some data chunks of an extent to provide respective first values for each of the at least some data chunks. A storage node, included within multiple storage nodes of a storage system, is selected to store the extent based on a majority vote derived from the respective first values.
Claims14
A method of selecting a storage node of a storage system to store data, comprising:
- applying, by a mapping node, a first function to at least some data chunks of an extent to provide respective first values for each of the at least some data chunks;
- selecting, by the mapping node, a storage node, included within multiple storage nodes of a storage system, to store the extent based on a majority vote derived from the respective first values;
- and
- performing, by the storage system, deduplication of the data chunks of the extent in the selected storage node using fingerprints computed on each of the data chunks, wherein one or more of the data chunks within the extent do not include useful data for a vote and the one or more of the data chunks within the extent that do not include useful data for the vote are not utilized in selecting the storage node to store the extent.
A storage system, comprising:
- a mapping node coupled to multiple storage nodes, wherein the mapping node is configured to:
- apply a first function to at least some data chunks of an extent to provide respective first values for each of the at least some data chunks;
- and
- select a storage node, included within the multiple storage nodes, to store the extent based on a majority vote derived from the respective first values;
- wherein the storage system is configured to perform deduplication of the data chunks of the extent in the selected storage node using fingerprints computed on each of the data chunks, and wherein one or more of the data chunks within the extent do not include useful data for a vote and the one or more of the data chunks within the extent that do not include useful data for the vote are not utilized in selecting the storage node to store the extent.
A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a controller of a storage system to cause the controller to:
- apply a first function to at least some data chunks of an extent to provide respective first values for each of the at least some data chunks;
- select a storage node, included within multiple storage nodes of a storage system, to store the extent based on a majority vote derived from the respective first values;
- and
- perform deduplication of the data chunks of the extent in the selected storage node using fingerprints computed on each of the data chunks, wherein one or more of the data chunks within the extent do not include useful data for a vote and the one or more of the data chunks within the extent that do not include useful data for the vote are not utilized in selecting the storage node to store the extent.
Dependencies are inferred from the claim text.