Back to results
US 2013/0232125 A1Published application
Stream locality delta compression
AssigneeEMC Corporation
InventorsMark Huang, Philip Shilane, Grant Wallace, Nitin Garg, Edward K. Lee, Ming Benjamin Zhu, Kai Li
Life of this patent
Estimating the term…
Abstract
Stream locality delta compression is disclosed. A previous stream indicated locale of data segments is selected. A first data segment is then determined to be similar to a data segment in the stream indicated locale.
Claims24
A system for processing data, comprising:
- a stream locality system having a processor to determine a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage, wherein sketches for the plurality of previously stored data segments satisfying the locality criterion are loaded into a limited sketch index;
- and
- a delta compression system having a processor to determine based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion.
A method for processing data, comprising:
- using a processor to determine a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage,
- using the processor to load sketches for the plurality of previously stored data segments satisfying the locality criterion into a limited sketch index;
- and
- using the processor to determine based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion.
1 more element
A computer program product for processing data, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
- determining a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of a stream currently being processed for storage,
- loading sketches for the plurality of previously stored data segments satisfying the locality criterion into a limited sketch index;
- and
- determining based at least in part on the limited sketch index that a first data segment included in the portion of the stream currently being processed for storage is similar to a similar data segment among the data segments in the locale by satisfying a similarity criterion.
1 more element
Dependencies are inferred from the claim text.