Monitoring lost data in a storage system

A method for data validation comprising:

• associating one or more validation data with respectively one or more data chunks stored on one or more storage mediums, each of the one or more data chunks comprising a plurality of subdivisions and each of the one or more validation data comprising a corresponding plurality of identifiers for verifying whether data recorded in a subdivision of said one or more data chunks is lost;
• receiving a request for an operation to be performed on first data stored in a first subdivision of a first data chunk from among said one or more data chunks;
• and
• examining a first identifier in first validation data to determine whether the data recorded in said first subdivision is deemed to be lost,
• wherein a data chunk comprises Y subdivisions and the validation information comprises N×Y identifiers, wherein N represents number of said one or more data chunks, an identifier corresponding to a respective subdivision on said N data chunks to indicate whether data recorded in a corresponding one of said Y subdivisions is lost,
• wherein the validation chunk further comprises Y redundancy data to provide a redundancy check for the N×Y identifiers across N data chunks, and
• wherein N and Y are integers greater than 1.

A system for data validation comprising:

• one or more processors for validating data;
• one or more storage mediums on which one or more data chunks are stored;
• wherein a validation chunk is associated with said one or more data chunks, the validation chunk comprising validation information for verifying whether data recorded in a subdivision of the one or more data chunks is lost;
• wherein in response to receiving a request for an operation to be performed on first data stored in a first subdivision of a first data chunk from among said one or more data chunks, one or more portions of the validation information are examined to determine whether the data recorded in said first subdivision is deemed to be lost,
• wherein a data chunk comprises Y subdivisions and the validation information comprises N×Y identifiers, wherein N represents number of said one or more data chunks, an identifier corresponding to a respective subdivision on said N data chunks to indicate whether data recorded in a corresponding one of said Y subdivisions is lost,
• wherein the validation chunk further comprises Y redundancy data to provide a redundancy check for the N×Y identifiers across N data chunks, and
• wherein N and Y are integers greater than 1.

A computer program product comprising a non-transient computer readable storage medium having a computer readable code stored thereon, wherein the computer readable code when executed on a computer causes the computer to:

• associate one or more validation data with respectively one or more data chunks stored on one or more storage mediums, each of the one or more data chunks comprising a plurality of subdivisions and each of the one or more validation data comprises a corresponding plurality of identifiers for verifying whether data recorded in a subdivision of one or more data chunks from among said one or more data chunks is lost;
• receive a request for an operation to be performed on first data stored in a first subdivision of a first data chunk from among said one or more data chunks;
• and
• examine a first identifier in first validation data to determine whether the data recorded in said first subdivision is deemed to be lost,
• wherein a data chunk comprises Y subdivisions and the validation information comprises N×Y identifiers, wherein N represents number of said one or more data chunks, an identifier corresponding to a respective subdivision on said N data chunks to indicate whether data recorded in a corresponding one of said Y subdivisions is lost,
• wherein the validation chunk further comprises Y redundancy data to provide a redundancy check for the N×Y identifiers across N data chunks, and
• wherein N and Y are integers greater than 1.