Method and system for personalising machine learning models
AssigneeSamsung Electronics Co., Ltd.
InventorsAlberto Gil C. P. RAMOS, Abhinav MEHROTRA, Sourav BHATTACHARYA
Life of this patent
Estimating the term…
Abstract
Broadly speaking, embodiments of the present techniques provide a method and system for personalising machine learning models on resource-constrained devices by using conditional neural networks. In particular, the present techniques allow for resource-efficient use of a conditioning vector by incorporating the conditioning vector into weights learned during training. This reduces the computational resources required at inference time.
Claims12
A computer-implemented method for training, on a server, a machine learning, ML, model having a first neural network and a second neural network, the method comprising:
- obtaining a training dataset comprising a plurality of pairs of data items to be processed by the ML model, each pair of data items comprising a conditioning vector that represents an individual user and an input data item;
- and
- training the ML model by jointly:
- training the first neural network of the ML model to transform weights of at least one layer of the second neural network into personalized weights for individual users using the conditioning vector of the pairs of data items;
- and
- training the second neural network of the ML model to process the input data item of the pairs of data items using the personalized weights for the at least one layer, and to generate output data.
A server for training a machine learning, ML, model having a first neural network and a second neural network, the server comprising:
- at least one processor coupled to memory and arranged to:
- obtain a training dataset comprising a plurality of pairs of data items to be processed by the ML model, each pair of data items comprising a conditioning vector that represents an individual user and an input data item;
- and
- train the ML model by jointly:
- training the first neural network of the ML model to transform weights of at least one layer of the second neural network into personalized weights for individual users using the conditioning vector of the pairs of data items;
- and
- training the second neural network of the ML model to process the input data item of the pairs of data items using the personalized weights for the at least one layer, and to generate output data.
Dependencies are inferred from the claim text.