# US 2026/0299811 A1 · Portion metadata for a deduplication storage system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0299811 A1
- Document ID: US20260299811A1
- Status: Published application
- Kind: A1
- Application number: 19/092,567
- Filed: 2025-03-27
- Published: 2026-10-01
- Earliest claimed: 2025-03-27
- Assignees: Hewlett Packard Enterprise Development LP
- Applicants: Hewlett Packard Enterprise Development LP
- Inventors: Noor Elreidy; Richard Phillip Mayo
- Web page: https://patentgrep.com/patent/US20260299811A1

## CPC

- G06F 3/0641: {De-duplication techniques}
- G06F 3/0608: {Saving storage space on storage systems}
- G06F 3/0652: {Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Example implementations relate to deduplication operations in a storage system. An example includes receiving a first portion of an initial data stream to be stored in a persistent storage of a deduplication storage system, where the first portion includes a set of multiple data units arranged in a received order. The example also includes generating a set of unit fingerprints for the set of data units in the first portion, and generating a first portion fingerprint as a function of the set of unit fingerprints. The example also includes storing the set of data units in a container entity group (CEG) object, storing portion metadata that includes the first portion fingerprint in a container index, and storing unit metadata that includes the set of unit fingerprints in a header of the CEG object.

## Claims

### Claim 1

A computing device comprising:
a processor;
a memory; and
a machine-readable storage storing instructions, the instructions executable by the processor to:
receive a first portion of an initial data stream to be stored in a persistent storage of a deduplication storage system, wherein the first portion includes a first set of data units, the first set of data units including a plurality of data units arranged in a received order;
generate a set of unit fingerprints, wherein each unit fingerprint of the set of unit fingerprints identifies a different data unit included in the first portion;
generate a first portion fingerprint as a function of the set of unit fingerprints, wherein the first portion fingerprint identifies the first portion;
store the first set of data units in a container entity group (CEG) object;
store portion metadata in a container index, wherein the portion metadata includes the first portion fingerprint;
store unit metadata in a header of the CEG object, wherein the unit metadata includes the set of unit fingerprints for the first set of data units;
receive a second portion of a second data stream;
generate a second portion fingerprint based on the second portion; and
determine, based on a comparison of the second portion fingerprint to the first portion fingerprint, whether the second portion is already stored in the deduplication storage system.

### Claim 2 (depends on 1)

The computing device of claim 1, including instructions executable by the processor to:
store the first portion fingerprint and the set of unit fingerprints in a first entry of a portion mapping structure.

### Claim 3 (depends on 2)

The computing device of claim 2, including instructions executable by the processor to:
read a first data unit in the second portion of the second data stream;
generate a first unit fingerprint for the first data unit; and
compare the generated first unit fingerprint to one or more entries in the portion mapping structure.

### Claim 4 (depends on 3)

The computing device of claim 3, including instructions executable by the processor to, in response to a determination that the generated first unit fingerprint matches one of the unit fingerprints stored in the first entry of the portion mapping structure:
determine a count of data units included in the first portion;
read one or more following data units in the second data stream;
generate a second set of unit fingerprints based on a second set of data units, wherein a total number of the second set of data units is equal to the determined count, and wherein the second set of data units includes the first data unit and the one or more following data units;
generate the second portion fingerprint using the second set of unit fingerprints; and
compare the second portion fingerprint to the first portion fingerprint stored in the first entry of the portion mapping structure.

### Claim 5 (depends on 4)

The computing device of claim 4, including instructions executable by the processor to, in response to a determination that the second portion fingerprint matches the first portion fingerprint stored in the first entry of the portion mapping structure:
increment, in the portion metadata stored in the container index, a reference count for the first portion.

### Claim 6 (depends on 4)

The computing device of claim 4, including instructions executable by the processor to, in response to a determination that the second portion fingerprint does not match the first portion fingerprint stored in the first entry of the portion mapping structure:
read the unit metadata stored in the header of the CEG object;
create, using the unit metadata, container index entries for the first set of data units stored in the CEG object;
delete the portion metadata stored in the container index; and
delete the first entry of the portion mapping structure.

### Claim 7 (depends on 3)

The computing device of claim 3, including instructions executable by the processor to, in response to a determination that the generated first unit fingerprint does not match any unit fingerprints stored in the one or more entries in the portion mapping structure:
compare the generated first unit fingerprint to at least one unit fingerprint stored in the container index.

### Claim 8 (depends on 2)

The computing device of claim 2, including instructions executable by the processor to:
receive third portion of a third data stream, wherein the third portion includes a third set of data units;
in response to a determination that the third set of data units is stored, in the same order, in the CEG object:
determine whether each data unit of the third set of data units has a same reference count;
in response to a determination that each data unit of the third set of data units has the same reference count, generate a third portion fingerprint based on unit fingerprints of the third set of data units;
store the third portion fingerprint in a second entry of the portion mapping structure;
record the third portion fingerprint in a new container index entry for the third portion; and
delete container index entries for the third set of data units.

### Claim 9

A method comprising:
receiving, by a storage controller of a deduplication storage system, a first portion of an initial data stream to be stored in a persistent storage of a deduplication storage system, wherein the first portion includes a first set of data units, the first set of data units including a plurality of data units arranged in a received order;
generating, by the storage controller, a set of unit fingerprints, wherein each unit fingerprint of the set of unit fingerprints identifies a different data unit included in the first portion;
generating, by the storage controller, a first portion fingerprint as a function of the set of unit fingerprints, wherein the first portion fingerprint identifies the first portion;
storing, by the storage controller, the first set of data units in a container entity group (CEG) object;
storing, by the storage controller, portion metadata in a container index, wherein the portion metadata includes the first portion fingerprint;
storing, by the storage controller, unit metadata in a header of the CEG object, wherein the unit metadata includes the set of unit fingerprints for the first set of data units;
receiving, by the storage controller, a second portion of a second data stream;
generating, by the storage controller, a second portion fingerprint based on the second portion; and
determining by the storage controller, based on a comparison of the second portion fingerprint to the first portion fingerprint, whether the second portion is already stored in the deduplication storage system.

### Claim 10 (depends on 9)

The method of claim 9, comprising:
storing the first portion fingerprint and the set of unit fingerprints in a first entry of a portion mapping structure.

### Claim 11 (depends on 10)

The method of claim 10, comprising:
reading a first data unit in the second portion of the second data stream;
generating a first unit fingerprint for the first data unit; and
comparing the generated first unit fingerprint to one or more entries in the portion mapping structure.

### Claim 12 (depends on 11)

The method of claim 11, comprising, in response to a determination that the generated first unit fingerprint matches one of the unit fingerprints stored in the first entry of the portion mapping structure:
determining a count of data units included in the first portion;
reading one or more following data units in the second data stream;
generating a second set of unit fingerprints based on a second set of data units, wherein a total number of the second set of data units is equal to the determined count, and wherein the second set of data units includes the first data unit and the one or more following data units;
generating the second portion fingerprint using the second set of unit fingerprints; and
comparing the second portion fingerprint to the first portion fingerprint stored in the first entry of the portion mapping structure.

### Claim 13 (depends on 12)

The method of claim 12, comprising, in response to a determination that the second portion fingerprint matches the first portion fingerprint stored in the first entry of the portion mapping structure:
incrementing, in the portion metadata stored in the container index, a reference count for the first portion.

### Claim 14 (depends on 12)

The method of claim 12, comprising, in response to a determination that the second portion fingerprint does not match the first portion fingerprint stored in the first entry of the portion mapping structure:
reading the unit metadata stored in the header of the CEG object;
creating, using the unit metadata, container index entries for the first set of data units stored in the CEG object;
deleting the portion metadata stored in the container index; and
deleting the first entry of the portion mapping structure.

### Claim 15

A non-transitory machine-readable medium storing instructions that upon execution cause a processor to:
receive a first portion of an initial data stream to be stored in a persistent storage of a deduplication storage system, wherein the first portion includes a first set of data units, the first set of data units including a plurality of data units arranged in a received order;
generate a set of unit fingerprints, wherein each unit fingerprint of the set of unit fingerprints identifies a different data unit included in the first portion;
generate a first portion fingerprint as a function of the set of unit fingerprints, wherein the first portion fingerprint identifies the first portion;
store the first set of data units in a container entity group (CEG) object;
store portion metadata in a container index, wherein the portion metadata includes the first portion fingerprint;
store unit metadata in a header of the CEG object, wherein the unit metadata includes the set of unit fingerprints for the first set of data units;
receive a second portion of a second data stream;
generate a second portion fingerprint based on the second portion; and
determine, based on a comparison of the second portion fingerprint to the first portion fingerprint, whether the second portion is already stored in the deduplication storage system.

### Claim 16 (depends on 15)

The non-transitory machine-readable medium of claim 15, including instructions that upon execution cause the processor to:
store the first portion fingerprint and the set of unit fingerprints in a first entry of a portion mapping structure.

### Claim 17 (depends on 16)

The non-transitory machine-readable medium of claim 16, including instructions that upon execution cause the processor to:
read a first data unit in the second portion of the second data stream;
generate a first unit fingerprint for the first data unit; and
compare the generated first unit fingerprint to one or more entries in the portion mapping structure.

### Claim 18 (depends on 17)

The non-transitory machine-readable medium of claim 17, including instructions that upon execution cause the processor to, in response to a determination that the generated first unit fingerprint matches one of the unit fingerprints stored in the first entry of the portion mapping structure:
determine a count of data units included in the first portion;
read one or more following data units in the second data stream;
generate a second set of unit fingerprints based on a second set of data units, wherein a total number of the second set of data units is equal to the determined count, and wherein the second set of data units includes the first data unit and the one or more following data units;
generate the second portion fingerprint using the second set of unit fingerprints; and
compare the second portion fingerprint to the first portion fingerprint stored in the first entry of the portion mapping structure.

### Claim 19 (depends on 18)

The non-transitory machine-readable medium of claim 18, including instructions that upon execution cause the processor to, in response to a determination that the second portion fingerprint matches the first portion fingerprint stored in the first entry of the portion mapping structure:
increment, in the portion metadata stored in the container index, a reference count for the first portion.

### Claim 20 (depends on 18)

The non-transitory machine-readable medium of claim 18, including instructions that upon execution cause the processor to, in response to a determination that the second portion fingerprint does not match the first portion fingerprint stored in the first entry of the portion mapping structure:
read the unit metadata stored in the header of the CEG object;
create, using the unit metadata, container index entries for the first set of data units stored in the CEG object;
delete the portion metadata stored in the container index; and
delete the first entry of the portion mapping structure.
