Hierarchical data integrity verification of erasure coded data in a distributed computing system

A system for providing hierarchical data integrity verification of erasure coded data, the system comprising:

• one or more computer processors;
• and
• computer memory storing computer-useable instructions that, when used by the one or more computer processors, cause the one or more computer processors to execute a data manager configured to:
• access data fragments that are erasure coded fragments and a parity fragment generated from the data fragments, wherein the data fragments and the parity fragment correspond to source data;
• generate, based on a non-cryptographic hash function, data-fragment message-digests, data-parity message-digests, or a parity-fragment message-digest,
• wherein, based on a linear property of the non-cryptographic hash function, a data integrity of the source data is verifiable based on the data-fragment message-digests, the data-parity message-digests, or the parity-fragment message-digest and a linear operation;
• cause storing of the data fragments and corresponding data-fragment message-digests or data-parity message digests at two or more corresponding data fragment zones;
• cause storing of a parity fragment and corresponding parity-fragment message-digest at a parity fragment zone;
• execute a local data integrity verification operation for a first data fragment to determine whether a match exists between compared message-digests, wherein the local data integrity verification operation:
• compares a local data-fragment message-digest of the first data fragment to a source data-fragment message-digest of the data fragment in a data fragment zone;
• or
• compares a local data-parity message-digest of the first data fragment to a source data-parity message-digest of the data fragment in the data fragment zone;
• or
• execute a global data integrity verification operation for the source data to determine whether a match exists between compared message-digests, wherein the global data integrity verification operation:
• compares a parity-fragment message-digest to a linear operation combination of data-parity message-digests of the source data, wherein the data-parity message-digests are retrieved from the two or more data fragment zones;
• or
• compares a source-data message-digest to a linear operation combination of data-fragment message-digests of the source data, wherein the data-fragment message-digests are retrieved from the two or more data fragment zones.