Data deduplication parameter computation
AssigneeHewlett Packard Enterprise Development LP
InventorMatti Vanninen
Life of this patent
Estimating the term…
Abstract
In some examples, a system computes respective values for corresponding data value indicators added to and removed from a deduplication data store in which duplicated data values have been eliminated, where each respective data value indicator of the data value indicators represents presence of a unique data value in the deduplication data store. The system updates an estimator based on the respective values, to reflect an addition of a first data value indicator to the deduplication data store and a removal of a second data value indicator from the deduplication data store. The system computes, using the updated estimator, a parameter relating to data deduplication at the deduplication data store.
Claims20
A non-transitory machine-readable storage medium comprising instructions that upon execution cause a system to:
- compute respective values for corresponding data value indicators added to and removed from a deduplication data store in which duplicated data values have been eliminated, wherein each respective data value indicator of the data value indicators represents presence of a unique data value in the deduplication data store;
- update an estimator based on the respective values, to reflect an addition of a first data value indicator to the deduplication data store and a removal of a second data value indicator from the deduplication data store;
- and
- compute, using the updated estimator, a parameter relating to data deduplication at the deduplication data store.
A system comprising:
- a processor;
- and
- a non-transitory storage medium storing instructions executable on the processor to:
- compute respective values for corresponding storage location indicators added to and removed from a deduplication data store in which duplicated data values have been eliminated, wherein each respective storage location indicator of the storage location indicators represents a respective storage location of a unique data value in the deduplication data store;
- update an estimator based on the respective values, to reflect an addition of a first storage location indicator to the deduplication data store and a removal of a second storage location indicator from the deduplication data store;
- and
- compute, using the updated estimator, a parameter relating to data deduplication at the deduplication data store.
A method of a system comprising a hardware processor, comprising:
- computing respective hash values based on content of corresponding storage location indicators added to and removed from a deduplication data store in which duplicated data values have been eliminated, wherein each respective storage location indicator of the storage location indicators represents a respective storage location of a unique data value in the deduplication data store;
- updating a probabilistic cardinality estimator based on the respective hash values, to reflect an addition of a first storage location indicator to the deduplication data store and a removal of a second storage location indicator from the deduplication data store, wherein the probabilistic cardinality estimator comprises counters, and the updating comprises advancing a first counter of the counters responsive to the addition of the first storage location indicator, and reversing the first counter responsive to the removal of the second storage location indicator;
- and
- compute, using the updated probabilistic cardinality estimator, a parameter relating to data deduplication at the deduplication data store.
Dependencies are inferred from the claim text.