Method and system for offloading a continuous health-check and reconstruction of data using compute acceleration devices on persistent storage devices

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing data, the method comprising:

• identifying, by a compute acceleration device (CAD) of a persistent storage device, a first chunk, stored in the persistent storage device, to be health-checked using storage metadata;
• generating a first chunk identifier using the first chunk;
• making a determination that the first chunk identifier does not match a second chunk identifier stored in the storage metadata;
• and
• in response to the determination:
• obtaining a plurality of chunks associated with the first chunk from a plurality of persistent storage devices of a storage system, wherein the storage system comprises the persistent storage device and the plurality of persistent storage devices;
• regenerating the first chunk using the plurality of chunks to generate a new first chunk;
• storing the new first chunk in the persistent storage device;
• and
• updating the storage metadata based on storage of the new first chunk.

A data cluster, comprising:

• a storage controller;
• a persistent storage device;
• a plurality of persistent storage devices;
• and
• a compute acceleration device (CAD) operating on the persistent storage device,
• wherein the first storage controller is programmed to:
• identify, by the CAD, a first chunk, stored in the persistent storage device, to be health-checked using storage metadata;
• generate a first chunk identifier using the first chunk;
• make a determination that the first chunk identifier does not match a second chunk identifier stored in the storage metadata;
• and
• in response to the determination:
• obtain a plurality of chunks associated with the first chunk from the plurality of persistent storage devices of a storage system, wherein the storage system comprises the persistent storage device and the plurality of persistent storage devices;
• regenerate the first chunk using the plurality of chunks to generate a new first chunk;
• store the new first chunk in the persistent storage device;
• and
• update the storage metadata based on storage of the new first chunk.