Neural network model compression with quantizability regularization
AssigneeTencent America LLC
InventorsWei JIANG, Wei WANG, Shan LIU
Life of this patent
Estimating the term…
Abstract
A method, computer program, and computer system is provided for compressing a neural network model. A multi-dimensional tensor corresponding to a set of weight coefficients associated with a neural network is reshaped. A subset of weight coefficients is identified from among the set of weight coefficients. A model of the neural network is compressed based on the identified subset of weight coefficients.
Claims20
A method for compressing a neural network model, executable by a processor, comprising:
- reshaping a multi-dimensional tensor corresponding to a set of weight coefficients associated with a neural network;
- identifying a subset of weight coefficients from among the set of weight coefficients;
- and
- compressing a model of the neural network based on the identified subset of weight coefficients.
A computer system for compressing a neural network model, the computer system comprising:
- one or more computer-readable non-transitory storage media configured to store computer program code;
- and
- one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
- reshaping code configured to cause the one or more computer processors to reshape a multi-dimensional tensor corresponding to a set of weight coefficients associated with a neural network;
- identifying code configured to cause the one or more computer processors to identify a subset of weight coefficients from among the set of weight coefficients;
- and
- compressing code configured to cause the one or more computer processors to compress a model of the neural network based on the identified subset of weight coefficients.
A non-transitory computer readable medium having stored thereon a computer program for compressing a neural network model, the computer program configured to cause one or more computer processors to:
- reshape a multi-dimensional tensor corresponding to a set of weight coefficients associated with a neural network;
- identify a subset of weight coefficients from among the set of weight coefficients;
- and
- compress a model of the neural network based on the identified subset of weight coefficients.
Dependencies are inferred from the claim text.