Method and system for lightening model for optimizing to equipment- friendly model
AssigneeNota, Inc.
InventorsJaewoong Yun, Kyunghwan Shim
Life of this patent
Estimating the term…
Abstract
Disclosed is a model compression method and system for compressing a model for optimizing to an equipment-friendly model. A model compression method may include acquiring criteria and sparsity for each filter of a model to which unstructured pruning is already applied, determining a filter for applying structured pruning among filters of the model based on the criteria and the sparsity, and applying the structured pruning to the model based on the determined filter.
Claims20
A model compression method of a computer device comprising at least one processor, the model compression method comprising:
- receiving, by the at least one processor, a model to which unstructured pruning is applied;
- deriving, by the at least one processor, criteria and sparsity for each filter of the model;
- determining, by the at least one processor, a filter for applying structured pruning among filters of the model based on the criteria and the sparsity;
- and
- generating, by the at least one processor, a compressed model by applying the structured pruning to the model based on the determined filter.
An inference method of a computer device comprising at least one processor, the inference method comprising:
- processing inference for input data using a first model compressed by determining a filter for applying structured pruning among filters of a second model based on criteria and sparsity for each filter of the second model to which unstructured pruning is already applied and by removing the determined filter from the second model.
A computer device comprising:
- at least one processor configured to execute computer-readable instructions,
- wherein the at least one processor is configured to:
- receive a model to which unstructured pruning is applied;
- derive criteria and sparsity for each filter of the model to which unstructured pruning is already applied,
- determine a filter for applying structured pruning among filters of the model based on the criteria and the sparsity, and
- generate a compressed model by applying the structured pruning to the model based on the determined filter.
Dependencies are inferred from the claim text.