Polymorphic pruning of neural networks
AssigneeEntanglement, Inc.
InventorsAnna HUGHES, Amit VERMA, Haibo WANG, Gary KOCHENBERGER, Fred GLOVER, Amit HULANDAGERI
Life of this patent
Estimating the term…
Loading patent…
AssigneeEntanglement, Inc.
InventorsAnna HUGHES, Amit VERMA, Haibo WANG, Gary KOCHENBERGER, Fred GLOVER, Amit HULANDAGERI
Estimating the term…
A method and system for polymorphic pruning of neural networks are disclosed. The method involves training a neural network model on an input dataset for an initial predetermined number of iterations to gather weight information, including the strength of each weight and changes in strength over iterations. The weights are stored in an array accessible to a pruning algorithm. An objective function is compiled using the weight information, and an optimization tool solves the objective function to generate a solution vector. This solution vector is used to create a pruning mask, which is applied to the neural network model to prune certain weights by setting them to zero. The pruned weight vector updates the model, resulting in a neural network with fewer non-zero connections between neurons.
A method comprising:
A pruning system comprising:
A non-transitory computer-readable storage medium storing a plurality of instructions executable by a processor, the plurality of instructions when executed by the processor cause the processor to perform operations comprising:
Dependencies are inferred from the claim text.