Techniques for accelerating machine learning models

One or more non-transitory computer readable media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• parsing a trained machine learning model to identify one or more layers of the trained machine learning model and, for each layer included in the one or more layers, one or more corresponding compression techniques that can be applied to compress the layer;
• performing, based on a hardware device on which the trained machine learning model is intended to execute, one or more iterative operations to select, for each layer included in the one or more layers, a compression technique included in the one or more corresponding compression techniques and values of one or more parameters associated with the compression technique;
• and
• compressing each layer included in the one or more layers using the compression technique that is selected for the layer and the values of the one or more parameters associated with the compression technique to generate a compressed trained machine learning model.

A system comprising:

• one or more memories storing instructions;
• and
• one or more processors coupled to the one or more memories that, when executing the instructions, perform the steps of:
• parsing the trained machine learning model to identify one or more layers of the trained machine learning model and, for each layer included in the one or more layers, one or more corresponding compression techniques that can be applied to compress the layer,
• performing, based on a hardware device on which the trained machine learning model is intended to execute, for each layer included in the one or more layers, a compression technique included in the one or more corresponding compression techniques and values of one or more parameters associated with the compression technique, and
• compressing each layer included in the one or more layers using the compression technique that is selected for the layer and the values of the one or more parameters associated with the compression technique to generate a compressed trained machine learning model.