Method and system for performing data deduplication and compression in a data cluster

A system, comprising:

• a processor;
• a data processor, which when executed by the processor performs a method, the method comprising:
• obtaining host data from a host;
• making a first determination that a data cluster comprises a plurality of non-volatile memory devices;
• based on the first determination:
• storing processed data corresponding to the host data in at least one of the plurality of non-volatile memory devices, wherein the processed data is generated based on a protection policy specifying requirements for generating and storing the processed data associated with the host data;
• and
• making a second determination to de-stage at least a portion of the processed data to a persistent storage device;
• and
• based on the second determination, initiating a delayed compression operation on the processed data.

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method, the method comprising:

• obtaining host data from a host;
• making a first determination that a data cluster comprises a plurality of non-volatile memory devices;
• based on the first determination:
• storing processed data corresponding to the host data in at least one of the plurality of non-volatile memory devices, wherein the processed data is generated based on a protection policy specifying requirements for generating and storing the processed data associated with the host data;
• and
• making a second determination to de-stage at least a portion of the processed data to a persistent storage device;
• and
• based on the second determination, initiating a delayed compression operation on the processed data.