Controlling segment size distribution in hash-based deduplication
AssigneeInternational Business Machines Corporation
InventorsMichael Hirsch, Shmuel T. Klein, Yair Toaff
Life of this patent
Estimating the term…
Abstract
Segment sizes are controlled by setting the size of a segment boundary in a hash-based deduplication system. A subsequence of size K of a sequence of characters S is set. An increasing sequence of n probabilities and a corresponding sequence of n decreasingly restrictive logical tests are chosen to be applied on the sequence of characters S. Segment boundaries are set by using the sequence of the decreasingly restrictive logical tests by deciding to declare a segment boundary at a current position if one of the sequence of the decreasingly restrictive logical tests, with a corresponding probability of the sequence of n probabilities, returns a true value when applied on the sequence of characters S.
Claims30
A method for controlling the distribution of segment sizes in a deduplication system using a processor device in a computing environment, the method comprising:
- setting a subsequence of size K of a sequence of characters S;
- choosing an increasing sequence of n probabilities and a corresponding sequence of n decreasingly restrictive logical tests to be applied on the sequence of characters S;
- and
- declaring segment boundaries by using the sequence of the decreasingly restrictive logical tests by deciding to declare a segment boundary at a current position if one of the sequence of the decreasingly restrictive logical tests, with a corresponding probability of the sequence of n probabilities, returns a true value when applied on the sequence of characters S.
A system controlling the distribution of segment sizes in a deduplication system in a computing environment, the system comprising:
- a CPU device operable in the computing storage environment, wherein the CPU device:
- sets a subsequence of size K of a sequence of characters S,
- chooses an increasing sequence of n probabilities and a corresponding sequence of n decreasingly restrictive logical tests to be applied on the sequence of characters S, and
- sets segment boundaries by using the sequence of the decreasingly restrictive logical tests by deciding to declare a segment boundary at a current position if one of the sequence of the decreasingly restrictive logical tests, with a corresponding probability of the sequence of n probabilities, returns a true value when applied on the sequence of characters S.
A computer program product controlling the distribution of segment sizes in a deduplication system by a processor device, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
- a first executable portion that sets a subsequence of size K of a sequence of characters S,
- a second executable portion that chooses an increasing sequence of n probabilities and a corresponding sequence of n decreasingly restrictive logical tests to be applied on the sequence of characters S, and
- a third executable portion that sets segment boundaries by using the sequence of the decreasingly restrictive logical tests by deciding to declare a segment boundary at a current position if one of the sequence of the decreasingly restrictive logical tests, with a corresponding probability of the sequence of n probabilities, returns a true value when applied on the sequence of characters S.
Dependencies are inferred from the claim text.