System and method for filesystem deduplication using variable length sharing

A computer readable storage medium having stored thereon, computer executable instructions that, if executed by a computer system cause the computer system to perform a method for filesystem deduplication comprising:

• accessing, within an electronic system, a plurality of files in a primary storage filesystem;
• determining a plurality of fingerprints for said plurality of files, wherein each respective fingerprint has a small fingerprint granularity and corresponds to a respective portion of a respective file of said plurality of files;
• determining a plurality of portions of said plurality of files where each of said plurality of portions has the same corresponding fingerprint;
• accessing a list comprising a plurality of portions of files previously deduplicated;
• and
• deduplicating a portion of a file of said plurality of files not present in said list, wherein said deduplicating comprises deduplicating consecutive portions of variable lengths of said plurality of files having the same corresponding fingerprints in response to a single function call.

A storage system, comprising:

• a computer system comprising one or more processors coupled to a computer readable storage media and configurable to execute computer readable code stored on the computer readable storage media which causes the computer system to implement a method comprising:
• accessing, within an electronic system, a plurality of files in a primary storage filesystem;
• determining a plurality of fingerprints for said plurality of files, wherein each respective fingerprint has a small fingerprint granularity and corresponds to a respective portion of a respective file of said plurality of files;
• determining a plurality of portions of said plurality of files where each of said plurality of portions has the same corresponding fingerprint;
• accessing a list comprising a plurality of portions of files previously deduplicated;
• and
• deduplicating a portion of a file of said plurality of files not present in said list, wherein said deduplicating comprises deduplicating consecutive portions of variable lengths of said plurality of files having the same corresponding fingerprints in response to a single function call.