US 12,737,263 B2Granted

Overflow container indexes for a deduplication storage system

AssigneeHewlett Packard Enterprise Development LP

InventorCallum Murray

Life of this patent

Estimating the term…

Loading patent…

Abstract

Example implementations relate to deduplication operations in a storage system. An example includes receiving a data stream that includes multiple locality portions. The example also includes, upon determining that a first container index for a first portion has insufficient capacity to store metadata of a first set of new data units in the first portion, instantiating a first overflow container index associated with the first portion, and storing the metadata of the first set of new data units in the first overflow container index. The example also includes, upon determining that a second container index associated with a second portion has insufficient capacity to store metadata of a second set of new data units in the second portion, instantiating a second overflow container index associated with the second portion, and storing the metadata of the second set of new data units in the second overflow container index.

Claims20

Dependent claims

A computing device comprising:

at least one processor;
a memory;
and
at least one machine-readable storage storing instructions, the instructions executable by the processor to:
receive a data stream to be stored in persistent storage of a deduplication storage system, wherein the data stream comprises a plurality of locality portions each comprising a plurality of data units;
in response to a determination that a first container index associated with a first locality portion of the data stream has insufficient capacity to store metadata of a first set of new data units included in the first locality portion, instantiate a first overflow container index associated with the first locality portion;
store, in the first container index associated with the first locality portion, a pointer to the first overflow container index associated with the first locality portion;
store the metadata of the first set of new data units in the first overflow container index associated with the first locality portion;
in response to a determination that a second container index associated with a second locality portion of the data stream has insufficient capacity to store metadata of a second set of new data units included in the second locality portion, instantiate a second overflow container index associated with the second locality portion;
and
store the metadata of the second set of new data units in the second overflow container index associated with the second locality portion.

8 more elements

A method comprising:

receiving, by a storage controller of a deduplication storage system, a data stream to be stored in persistent storage of a deduplication storage system, wherein the data stream comprises a plurality of locality portions each comprising a plurality of data units;
in response to a determination that a first container index associated with a first locality portion of the data stream has insufficient capacity to store metadata of a first set of new data units included in the first locality portion, instantiating, by the storage controller, a first overflow container index associated with the first locality portion;
storing in the first container index associated with the first locality portion, by the storage controller, a pointer to the first overflow container index associated with the first locality portion;
storing, by the storage controller, the metadata of the first set of new data units in the first overflow container index associated with the first locality portion;
in response to a determination that a second container index associated with a second locality portion of the data stream has insufficient capacity to store metadata of a second set of new data units included in the second locality portion, instantiating, by the storage controller, a second overflow container index associated with the second locality portion;
and
storing, by the storage controller, the metadata of the second set of new data units in the second overflow container index associated with the second locality portion.

4 more elements

A non-transitory machine-readable storage medium comprising instructions executable by at least one processor to:

receive a data stream to be stored in persistent storage of a deduplication storage system, wherein the data stream comprises a plurality of locality portions each comprising a plurality of data units;
in response to a determination that a first container index associated with a first locality portion of the data stream has insufficient capacity to store metadata of a first set of new data units included in the first locality portion, instantiate a first overflow container index associated with the first locality portion;
store, in the first container index associated with the first locality portion, a pointer to the first overflow container index associated with the first locality portion;
store the metadata of the first set of new data units in the first overflow container index associated with the first locality portion;
in response to a determination that a second container index associated with a second locality portion of the data stream has insufficient capacity to store metadata of a second set of new data units included in the second locality portion, instantiate a second overflow container index associated with the second locality portion;
and
store the metadata of the second set of new data units in the second overflow container index associated with the second locality portion.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/925,311Filed 24 Oct 2024
Published: US 2026/0119330 A130 Apr 2026
Granted: 15 Sep 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06F 11/1453
Management of the data involved in backup or backup restore: using de-duplication of the data
G06F 16/1748
Redundancy elimination performed by the file system: de-duplication implemented within the file system, e.g. based on file segments
G06F 16/1752
De-duplication implemented within the file system, e.g. based on file segments: based on file chunks
G06F 16/215
Design, administration or maintenance of databases: improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or…