System and Method for Automatic Integrity Checks in a Key/Value Store

A method for data storage supporting data integrity check and recovery in a key-value store system, the method comprising:

• receiving a command to store a data block in the key-value store system, the data block including a key identifying the data block and a value representing data content;
• calculating an integrity value for the data block using a data integrity check algorithm,
• adding the calculated integrity value and the data integrity check algorithm to the data block;
• and
• storing one or more copies of the data block including the key, the value, the data integrity check algorithm, and the integrity value in one or more storage nodes of the key-value store system.

An apparatus for data storage supporting data integrity check and recovery in a key-value store system, the apparatus comprising:

• one or more storage nodes configured for storing one or more data blocks including key and value pairs;
• a processor;
• and
• a computer readable storage medium storing programming for execution by the processor, the programming including instructions to:
• receive a command to retrieve a data block stored at the one or more storage nodes, the command indicating a key associated with the data block;
• retrieve one or more copies of the stored data block including the key, a value, a data integrity check algorithm, and an integrity value;
• performing data integrity check on the retrieved one or more copies of the data block using the data integrity check algorithm, the integrity value, and at least one of the key and the value;
• upon one or more copies of the data block failing the data integrity check, repair the one or more copies of the data block;
• and
• deliver the data block.