Efficient data deduplication caching

A system comprising:

• one or more processors;
• and
• a memory comprising code stored thereon that, when executed, performs a method of processing data comprising:
• receiving a first data chunk and a first digest generated in accordance with the first data chunk;
• and
• performing data deduplication processing for the first data chunk comprising:
• determining whether there is an existing entry in a deduplication digest cache for the first digest;
• and
• responsive to determining there is no existing entry in the deduplication digest cache for the first digest, performing first processing including:
• determining whether there is an existing entry in a mapping structure for the first digest, wherein the mapping structure maps digests to associated pages of related entries in a deduplication data store;
• and
• responsive to determining there is an existing entry in the mapping structure for the first digest, performing second processing including:
• obtaining, from the existing entry of the mapping structure, a first page number mapped to the digest, wherein the first page number identifies a first page of a plurality of related entries of the deduplication data store and wherein the first page of the plurality of related entries of the deduplication data store includes a first entry for the data chunk and the digest of the data chunk;
• and
• responsive to obtaining the first page number from the existing entry of the mapping structure, loading the plurality of related entries of the first page from the deduplication data store into the deduplication digest cache, wherein each entry of the plurality related entries of the first page of the deduplication data store includes a different one of a plurality of digests.

A computer readable medium comprising code stored thereon that, when executed, performs a method of processing data comprising:

• receiving a first data chunk and a first digest generated in accordance with the first data chunk;
• and
• performing data deduplication processing for the first data chunk comprising:
• determining whether there is an existing entry in a deduplication digest cache for the first digest;
• and
• responsive to determining there is no existing entry in the deduplication digest cache for the first digest, performing first processing including:
• determining whether there is an existing entry in a mapping structure for the first digest, wherein the mapping structure maps digests to associated pages of related entries in a deduplication data store;
• and
• responsive to determining there is an existing entry in the mapping structure for the first digest, performing second processing including:
• obtaining, from the existing entry of the mapping structure, a first page number mapped to the digest, wherein the first page number identifies a first page of a plurality of related entries of the deduplication data store and wherein the first page of the plurality of related entries of the deduplication data store includes a first entry for the data chunk and the digest of the data chunk;
• and
• responsive to obtaining the first page number from the existing entry of the mapping structure, loading the plurality of related entries of the first page from the deduplication data store into the deduplication digest cache, wherein each entry of the plurality related entries of the first page of the deduplication data store includes a different one of a plurality of digests.