Low-Overhead Enhancement of Reliability of Journaled File System Using Solid State Storage and De-Duplication

A method, in a data processing system, for reliable asynchronous solid-state device based de-duplication, the method comprising:

• responsive to receiving a write request to write data to the file system, sending the write request to the file system;
• in parallel to sending the write request to the file system, computing a hash key for the write data;
• looking up the hash key in a de-duplication table, wherein the de-duplication table is stored in a memory or a solid-state storage device;
• and
• responsive to the hash key not existing in the de-duplication table, writing the write data to a storage device, writing a journal transaction comprising the hash key, and updating the de-duplication table to reference the write data in the storage device.

An apparatus, comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:
• responsive to receiving a write request to write data to the file system, send the write request to the file system;
• in parallel to sending the write request to the file system, compute a hash key for the write data;
• look up the hash key in a de-duplication table, wherein the de-duplication table is stored in a memory or a solid-state storage device;
• and
• responsive to the hash key not existing in the de-duplication table, write the write data to a storage device, write a journal transaction comprising the hash key, and update the de-duplication table to reference the write data in the storage device.