Adaptive compression mode

A method of data processing comprising:

• receiving, at a data storage system, a write operation that writes a data chunk;
• selecting, in accordance with one or more criteria related to load of at least one of the data storage system and the hardware device, a compression level to be used in connection with compressing the data chunk;
• issuing a request to a hardware device to perform compression processing that compresses the data chunk in accordance with the compression level selected and generates a compressed form of the data chunk;
• storing the compressed form of the data chunk on a non-volatile storage device;
• determining whether a current read load is above a first specified threshold, whether measured throughput of the hardware device is below a second specified threshold, and whether the compression level selected has an associated expected compression throughput that exceeds a third specified threshold;
• and
• responsive to determining the current read load is above the first specified threshold, the measured throughput of the hardware device is below the second specified threshold, and the compression level selected has the associated expected compression throughput that exceeds the third specified threshold, performing processing that reduces a current rate at which decompressed data is sent to the hardware device for decompressing.

A system comprising:

• at least one processor;
• and
• a memory comprising code stored thereon that, when executed, performs a method of data processing comprising:
• receiving, at a data storage system, a write operation that writes a data chunk;
• selecting, in accordance with criteria related to load of a hardware device that compresses and decompresses data, a compression level to be used in connection with compressing the data chunk, wherein the criteria include a read load related to decompression requests sent to the hardware device, a measured response time of the hardware device denoting an amount of time it takes the hardware device to generate an output with respect to compression and decompression requests, and a current level of cache consumed for storing write data, and wherein the current level of cache consumed for storing write data indicates a write load of compression requests sent to the hardware device;
• issuing a request to the hardware device to perform compression processing that compresses the data chunk in accordance with the compression level selected and generates a compressed form of the data chunk;
• and
• storing the compressed form of the data chunk on a non-volatile storage device.

A non-transitory computer readable medium comprising code stored thereon that, when executed, performs a method of data processing comprising:

• receiving, at a data storage system, a write operation that writes a data chunk;
• selecting, in accordance with criteria related to load of a hardware device that compresses and decompresses data, a compression level to be used in connection with compressing the data chunk, wherein the criteria include a read load related to decompression requests sent to the hardware device, a measured response time of the hardware device denoting an amount of time it takes the hardware device to generate an output with respect to compression and decompression requests, and a current level of cache consumed for storing write data, and wherein the current level of cache consumed for storing write data indicates a write load of compression requests sent to the hardware device;
• issuing a request to the hardware device to perform compression processing that compresses the data chunk in accordance with the compression level selected and generates a compressed form of the data chunk;
• and
• storing the compressed form of the data chunk on a non-volatile storage device.

A non-transitory computer readable medium comprising code stored thereon that, when executed, performs a method of data processing comprising:

• receiving, at a data storage system, a write operation that writes a data chunk;
• selecting, in accordance with one or more criteria related to load of at least one of the data storage system and the hardware device, a compression level to be used in connection with compressing the data chunk;
• issuing a request to a hardware device to perform compression processing that compresses the data chunk in accordance with the compression level selected and generates a compressed form of the data chunk;
• storing the compressed form of the data chunk on a non-volatile storage device;
• determining whether a current read load is above a first specified threshold, whether measured throughput of the hardware device is below a second specified threshold, and whether the compression level selected has an associated expected compression throughput that exceeds a third specified threshold;
• and
• responsive to determining the current read load is above the first specified threshold, the measured throughput of the hardware device is below the second specified threshold, and the compression level selected has the associated expected compression throughput that exceeds the third specified threshold, performing processing that reduces a current rate at which decompressed data is sent to the hardware device for decompressing.

A system comprising:

• at least one processor;
• and
• a memory comprising code stored thereon that, when executed, performs a method of data processing comprising:
• receiving, at a data storage system, a write operation that writes a data chunk;
• selecting, in accordance with one or more criteria related to load of at least one of the data storage system and the hardware device, a compression level to be used in connection with compressing the data chunk;
• issuing a request to a hardware device to perform compression processing that compresses the data chunk in accordance with the compression level selected and generates a compressed form of the data chunk;
• storing the compressed form of the data chunk on a non-volatile storage device;
• determining whether a current read load is above a first specified threshold, whether measured throughput of the hardware device is below a second specified threshold, and whether the compression level selected has an associated expected compression throughput that exceeds a third specified threshold;
• and
• responsive to determining the current read load is above the first specified threshold, the measured throughput of the hardware device is below the second specified threshold, and the compression level selected has the associated expected compression throughput that exceeds the third specified threshold, performing processing that reduces a current rate at which decompressed data is sent to the hardware device for decompressing.