US 2012/0233135 A1 · SAMPLING BASED DATA DE-DUPLICATION

Abstract

Example apparatus, methods, and computers perform sampling based data de-duplication. One example method controls a data de-duplication computer to compute a sampling sequence for a sub-block of data and to use the sampling sequence to locate a stored sub-block known to the data de-duplication computer. Upon finding a stored sub-block to compare to, the method includes controlling the data de-duplication computer to determine a degree of similarity (e.g., duplicate, very similar, somewhat similar, very dissimilar, completely dissimilar, x % similar) between the sub-block and the stored sub-block and to control whether and how the sub-block is stored and/or transmitted based on the degree of similarity. The degree of similarity can also control whether and how the data de-duplication computer updates a dedupe data structure(s) that stores information for finding groups of similarity sampling sequence related sub-blocks.

Claims26

Dependent claims

An apparatus, comprising:

a processor;
a memory;
and
an interface to connect the processor, memory, and a set of logics, the set of logics comprising:
a sampling sequence logic configured to produce a sampling sequence for a sub-block of data;
a similarity logic configured to determine a degree of similarity between the sub-block and a previously de-duplicated sub-block based, at least in part, on the sampling sequence;
and
a control logic configured to control whether and how the sub-block is de-duplicated based on the degree of similarity.

5 more elements

Dependencies are inferred from the claim text.

Sampling based data de-duplication

Life of this patent

Sampling based data de-duplication

Life of this patent

Abstract

Claims26