US 12,743,223 B2 · Aggregating data units in a deduplication storage system

Abstract

Example implementations relate to deduplication operations in a storage system. An example includes receiving a set of data units to be stored in persistent storage of a deduplication storage system, and recording the arrival order of the set of data units in a manifest. The example also includes, in response to determining that an average unit size of the set of data units is smaller than a minimum size threshold, identifying a first data unit that is smaller than the minimum size threshold. The example also includes generating an aggregated data unit including the first data unit and a second data unit, and, in response to determining that the size of the aggregated data unit is larger than a target size threshold, replacing, in the manifest, the first data unit and the second data unit with the aggregated data unit.

Claims20

Dependent claims

A computing device comprising:

at least one processor;
a memory;
and
at least one machine-readable storage medium comprising instructions executable by the at least one processor to:
receive a data stream to be stored in persistent storage of a deduplication storage system;
record, in a manifest, an arrival order of a set of data units included in the data stream;
determine whether an average unit size of the set of data units is smaller than a minimum size threshold;
in response to a determination that the average unit size of the set of data units is smaller than the minimum size threshold, identify a first data unit, of the set of data units, that is smaller than the minimum size threshold;
generate an aggregated data unit comprising the first data unit and a second data unit;
and
in response to a determination that a size of the aggregated data unit is larger than or equal to a target size threshold, replace, in the manifest, the first data unit and the second data unit with the aggregated data unit.

8 more elements

A method comprising:

receiving, by a storage controller of a deduplication storage system, a data stream to be stored in persistent storage of the deduplication storage system;
recording in a manifest, by the storage controller, an arrival order of a set of data units included in the data stream;
determining, by the storage controller, whether an average unit size of the set of data units is smaller than a minimum size threshold;
in response to a determination that the average unit size of the set of data units is smaller than the minimum size threshold, identifying, by the storage controller, a first data unit, of the set of data units, that is smaller than the minimum size threshold;
generating, by the storage controller, an aggregated data unit including the first data unit and a second data unit;
determining, by the storage controller, whether a size of the aggregated data unit is larger than a target size threshold;
and
in response to a determination that a size of the aggregated data unit is larger than a target size threshold, replacing in the manifest, by the storage controller, the first data unit and the second data unit with the aggregated data unit.

5 more elements

A non-transitory machine-readable storage medium comprising instructions executable by at least one processor to:

receive a set of data units to be stored in persistent storage of a deduplication storage system;
determine whether an average unit size of the set of data units is smaller than a minimum size threshold;
in response to a determination that the average unit size of the set of data units is smaller than the minimum size threshold, identify a first data unit, of the set of data units, that is smaller than the minimum size threshold;
generate an aggregated data unit comprising the first data unit and a second data unit;
and
in response to a determination that a size of the aggregated data unit is larger than or equal to a target size threshold, replace, in the set of data units, the first data unit and the second data unit with the aggregated data unit.

3 more elements

Dependencies are inferred from the claim text.

Aggregating data units in a deduplication storage system

Life of this patent

Aggregating data units in a deduplication storage system

Life of this patent

Abstract

Claims20