Using tensors in portions of a neural network

Abstract

Apparatuses, techniques, and/or software to reduce a number of weight parameter values for one or more neural networks by causing said one or more neural networks to use one or more tensors in two or more portions of the one or more neural networks. For example, apparatuses, techniques, processors, and/or software to generate a linear combination of tensors to approximate two or more layers of a neural network, where said same tensors can be used or repeated to approximate different portions of a neural network. In one or more embodiments, said two or more portions are generated and provided to said one or more neural networks using knowledge distillation techniques.

Dependencies are inferred from the claim text.