Selective deduplication
AssigneeNetApp, Inc.
InventorsDamarugendra Mallaiah, Jayanta Basak
Life of this patent
Estimating the term…
Abstract
Methods and apparatuses for performing selective deduplication in a storage system are introduced herein. Techniques are provided for determining deduplication priorities of data objects based upon projected likelihoods that deduplication of such data objects will provide a storage space benefit. Inline deduplication and/or post processing deduplication is selectively provided on an individual data object basis based upon deduplication priorities assigned to respective data objects.
Claims20
A method comprising:
- determining, by a processor of a computing device, a first deduplication priority for a first data object based upon a first projected likelihood that deduplication of the first data object will provide a storage space benefit to reduce storage consumption of a storage device;
- determining a second deduplication priority for a second data object based upon a second projected likelihood that deduplication of the second data object will provide the storage space benefit;
- and
- performing inline deduplication for the first data object but not the second data object based upon the first deduplication priority exceeding the second deduplication priority that is indicative of inline deduplication of the first data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the second data object.
A computing device comprising:
- a memory containing machine-readable storage media having stored thereon instructions for performing a method;
- and
- a processor coupled to the memory, the processor configured to execute the instructions to cause the processor to:
- determine a first deduplication probability threshold and a second deduplication probability threshold based upon a performance characteristic;
- create a multi-level deduplication probability comprising a hierarchical relationship between the first deduplication probability threshold and the second deduplication probability threshold;
- utilize the multi-level deduplication probability to assign deduplication priorities to data objects;
- and
- selectively perform inline deduplication but not post processing deduplication for the data objects based upon the deduplication priorities indicating that inline deduplication has a greater likelihood of achieving a storage space benefit to reduce storage consumption of a storage device than post processing deduplication.
A non-transitory machine-readable storage media having stored thereon instructions, for performing a method, which causes a computing device to:
- determine a first deduplication priority for a first data object based upon a first projected likelihood that deduplication of the first data object will provide a storage space benefit to reduce storage consumption of a storage device;
- determine a second deduplication priority for a second data object based upon a second projected likelihood that deduplication of the second data object will provide the storage space benefit;
- perform inline deduplication for the first data object and post-processing deduplication for the second data object based upon the first deduplication priority exceeding the second duplication priority that is indicative of inline deduplication of the first data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the second data object;
- and
- perform inline deduplication for the second data object and post-processing duplication for the first data object based upon the second deduplication priority exceeding the first deduplication priority that is indicative of inline deduplication of the second data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the first data object.
Dependencies are inferred from the claim text.