Computer system and method for quantizing artificial neural network model
AssigneeNota, Inc.
InventorsTairen Piao, Shinkook Choi
Life of this patent
Estimating the term…
Abstract
Provided is a quantization method of an artificial neural network model including a plurality of layers. The quantization method includes identifying an outlier from among activation elements output from a first layer among the layers of the artificial neural network model, determining and regularizing a weight to be regularized among weights applied to the first layer based on relevance with the identified outlier, and quantizing the artificial neural network model after the quantization.
Claims16
A quantization method of an artificial neural network model including a plurality of layers, performed by a computer system, the quantization method comprising:
- identifying at least one first outlier from among first activation elements output from a first layer among the layers;
- identifying second weight elements associated with the first outlier from among first weight elements applied in the first layer;
- regularizing a second weight element determined based on relevance with the first outlier, among the identified second weight elements;
- and
- performing quantization for at least one of third weight elements applied in the first layer after the regularization or activation elements output from the first layer.
A computer system to perform quantization of an artificial neural network model including a plurality of layers, the computer system comprising:
- at least one processor configured to execute computer-readable instructions in the computer system,
- wherein the at least one processor is configured to identify at least one first outlier from among first activation elements output from a first layer among the layers, to identify second weight elements associated with the first outlier from among first weight elements applied in the first layer, to regularize a second weight element determined based on relevance with the first outlier, among the identified second weight elements, and to perform quantization for at least one of third weight elements applied in the first layer after the regularization or activation elements output from the first layer.
Dependencies are inferred from the claim text.