Using machine learning to select compression algorithms for compressing binary datasets

A method comprising:

• in a storage system comprising at least one compute node that manages access to non-volatile storage, the compute node configured to respond to commands from host nodes to access host application data stored on the non-volatile storage, wherein the host application data comprises binary data:
• predicting compression efficiency of selected binary data by a plurality of compression algorithms using a data model that has been trained to predict compression efficiency of binary data structures with the data compression algorithms based on sizes of components of the binary data structures, where each of the binary data structures comprises a header, metadata, signature, encoding, and a plurality of the components;
• and
• based on predicted compressibility, selecting one of the plurality of data compression algorithms that will most efficiently compress the selected binary data;
• recommending the selected compression algorithm;
• and
• compressing the selected binary data using the recommended compression algorithm.

A computer-readable storage medium storing instructions that when executed by a compute node cause a storage system to perform a method for data compression, the method comprising:

• predicting compression efficiency of selected binary data by a plurality of compression algorithms using a data model that has been trained to predict compression efficiency of binary data structures by the data compression algorithms based on sizes of components of the binary data structures, where each of the binary data structures comprises a header, metadata, signature, encoding, and a plurality of the components;
• and
• based on predicted compression efficiency, selecting one of the plurality of data compression algorithms that will most efficiently compress the selected binary data;
• recommending the selected compression algorithm;
• and
• compressing the selected binary data using the recommended compression algorithm.