Systems and methods for deterministic error detection functions in large data structures

A method comprising:

• storing, by a processor, a plurality of records;
• applying, by the processor, a hash function to the plurality of records;
• generating, by the processor and based on the hash function, a hash index wherein each hash of the hash index is associated on a one-to-one basis with each record of the plurality of records;
• identifying, by the processor, matching hashes within the hash index;
• flagging, by the processor, the records associated with the matching hashes of the hash index for further processing.

An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a processor, cause the processor to perform operations comprising:

• storing, by a processor, a plurality of records;
• applying, by the processor, a hash function to the plurality of records;
• generating, by the processor and based on the hash function, a hash index wherein each hash of the hash index is associated on a one-to-one basis with each record of the plurality of records;
• identifying, by the processor, matching hashes within the hash index;
• flagging, by the processor, the records associated with the matching hashes of the hash index for further processing.