Determining chunk boundaries for deduplication of storage objects

A system for deduplicating a storage object comprised of a plurality of chunks of data, comprising:

• a processor;
• and
• a computer readable storage having program instructions executed by the processor to perform operations, the operations comprising:
• determining a hash of a window of data of a storage object;
• determining whether a characteristics of the hash of the window of data comprises a member of a set of predetermined mathematical properties, indicating an endpoint of a chunk boundary, consisting of an odd number, an even number, a prime number, and divisible by an integer;
• determining whether the hash of the window of data matches one pseudo fingerprint in a list of at least one pseudo fingerprint;
• storing a storage object chunk boundary based on the window of data in response to the hash of the window of data meeting one of the predetermined mathematical properties or in response to determining that the hash of the window of data matches one of the at least one pseudo fingerprint;
• determining a new window of data in the storage object following the window of data in response to storing the storage object chunk boundary when the window of data is not an end of data of the storage object;
• and
• performing deduplication on chunks defined by stored storage object chunk boundaries.

A computer program product for deduplicating a storage, the computer program product comprising a non-transitory computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising:

• determining a hash of a window of data of a storage object;
• determining whether a characteristic of the hash of the window of data comprises a member of a set of predetermined mathematical properties, indicating an endpoint of a chunk boundary, consisting of an odd number, an even number, a prime number, and divisible by an integer;
• determining whether the hash of the window of data matches one of at least one pseudo fingerprint in a list of at least one pseudo fingerprint;
• storing a storage object chunk boundary based on the window of data in response to the hash of the window of data meeting one of the predetermined mathematical properties or in response to determining that the hash of the window of data matches one of the at least one pseudo fingerprint;
• determining a new window of data in the storage object following the window of data in response to storing the storage object chunk boundary when the window of data is not an end of data of the storage object;
• and
• performing deduplication on chunks defined by stored storage object chunk boundaries.