Automated fine-tuning of a pre-trained neural network for transfer learning

A computer program product for generating parameters of a neural network, the computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by controller circuitry to cause the controller circuitry to perform operations comprising:

• obtaining a first target feature vector from a first layer of a pre-trained neural network responsive to a first target data element of a target dataset passing therethrough;
• obtaining a first source feature vector associated with the first layer of the pre-trained neural network;
• calculating a first divergence value for the first layer of the pre-trained neural network based at least in part on the first target feature vector and the first source feature vector;
• and
• setting a learning rate for the first layer of the pre-trained neural network based at least in part on the first divergence value.

A computer system comprising a processor and one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by the processor to cause the processor to perform operations comprising:

• obtaining a first target feature vector from a first layer of a pre-trained neural network responsive to a first target data element of a target dataset passing therethrough;
• obtaining a first source feature vector associated with the first layer of the pre-trained neural network;
• calculating a first divergence value for the first layer of the pre-trained neural network based at least in part on the first target feature vector and the first source feature vector;
• and
• setting a learning rate for the first layer of the pre-trained neural network based at least in part on the first divergence value.