Input/output de-duplication based on variable-size chunks

An article of manufacture comprising a non-transitory computer readable storage medium having computer readable instructions tangibly embodied thereon which, when implemented, cause a computer to carry out a plurality of method steps comprising:

• partitioning virtual block data into multiple variable-sized chunks;
• caching each of the multiple variable-sized chunks in a chunk cache according to content of each of the multiple variable-sized chunks;
• initializing virtual block-to-chunk mapping and chunk-to-physical block mapping for each of the multiple variable-sized chunks;
• and
• detecting duplicate disk input and/or output requests across multiple hosts based on (i) content-based mappings of the input and/or output requests to the chunk cache and (ii) the virtual block-to-chunk mapping and chunk-to-physical block mapping for each of the multiple variable-sized chunks in the chunk cache.

A system comprising:

• a memory;
• and
• at least one processor coupled to the memory and configured for:
• partitioning virtual block data into multiple variable-sized chunks;
• caching each of the multiple variable-sized chunks in a chunk cache according to content of each of the multiple variable-sized chunks;
• initializing virtual block-to-chunk mapping and chunk-to-physical block mapping for each of the multiple variable-sized chunks;
• and
• detecting duplicate disk input and/or output requests across multiple hosts based on (i) content-based mappings of the input and/or output requests to the chunk cache and (ii) the virtual block-to-chunk mapping and chunk-to-physical block mapping for each of the multiple variable-sized chunks in the chunk cache.

A method comprising:

• partitioning virtual block data into multiple variable-sized chunks;
• caching each of the multiple variable-sized chunks in a chunk cache according to content of each of the multiple variable-sized chunks;
• mapping the virtual block data to physical block data, wherein said mapping comprises performing virtual block-to-chunk mapping and chunk-to-physical block mapping for each of the multiple variable-sized chunks in the chunk cache;
• and
• processing an input and/or output request to detect a duplicate input and/or output request, wherein said processing comprises comparing a content-based mapping of the input and/or output request to the virtual block-to-chunk mapping and chunk-to-physical block mapping in the chunk cache to identify a corresponding one of the multiple variable-sized chunks in the chunk cache;
• wherein at least one of the steps is carried out by a computer device.