Back to results
US 9,069,785 B2Granted
Stream locality delta compression
AssigneeEMC Corporation
InventorsMark Huang, Philip Shilane, Grant Wallace, Nitin Garg, Edward K. Lee, Ming Benjamin Zhu, Kai Li
Life of this patent
Estimating the term…
Abstract
Stream locality delta compression is disclosed. A previous stream indicated locale of data segments is selected. A first data segment is then determined to be similar to a data segment in the stream indicated locale.
Claims24
A system for processing data, comprising:
- a stream locality system having a processor to determine a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage, wherein sketches for the plurality of previously stored data segments satisfying the locality criterion are loaded into a limited sketch index from a sketch cache;
- and
- a delta compression system having a processor to determine based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion,
- wherein the plurality of previously stored data segments satisfying the locality criterion correspond to a subset of previously stored data segments loaded in the sketch cache.
1 more element
A method for processing data, comprising:
- using a processor to determine a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage,
- using the processor to load sketches for the plurality of previously stored data segments satisfying the locality criterion into a limited sketch index from a sketch cache;
- and
- using the processor to determine based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion,
- wherein the plurality of previously stored data segments satisfying the locality criterion correspond to a subset of previously stored data segments loaded in the sketch cache.
2 more elements
A computer program product for processing data, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
- determining a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage,
- loading sketches for the plurality of previously stored data segments satisfying the locality criterion into a limited sketch index from a sketch cache;
- and
- determining based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion,
- wherein the plurality of previously stored data segments satisfying the locality criterion correspond to a subset of previously stored data segments loaded in the sketch cache.
2 more elements
Dependencies are inferred from the claim text.