Systems and methods of locating redundant data using patterns of matching fingerprints

A system configured to compute match potential between first data and second data, the system comprising:

• data storage storing the first data and the second data;
• and
• at least one processor coupled to the data storage and configured to:
• identify a first sequence of fingerprints characterizing a first plurality of sections of the first data, the first sequence being ordered according to an order of the first plurality of sections within the first data;
• identify a second sequence of fingerprints comprising fingerprints that match fingerprints within the first sequence, the second sequence of fingerprints characterizing a second plurality of sections of the second data, the second sequence being ordered according to an order of the second plurality of sections within the second data;
• quantify a similarity between the first sequence and the second sequence;
• and
• adjust the match potential based on the quantified similarity.

A non-transitory computer readable medium storing computer readable instructions that, when executed by at least one processor, instruct the at least one processor to perform a method of computing match potential between first data and second data, the method comprising:

• identifying a first sequence of fingerprints characterizing a first plurality of sections of the first data, the first sequence being ordered according to an order of the first plurality of sections within the first data;
• identifying a second sequence of fingerprints comprising fingerprints that match fingerprints within the first sequence, the second sequence of fingerprints characterizing a second plurality of sections of the second data, the second sequence being ordered according to an order of the second plurality of sections within the second data;
• quantifying a similarity between the first sequence and the second sequence;
• and
• adjusting the match potential based on the quantified similarity.