Computer-implemented method and computer system for configuring a pretrained text to music AI model and related methods

A computer system for configuring a pretrained text to music artificial intelligence (AI) model that includes a neural network implementing a diffusion model, the method comprising:

• at least one computer hardware processor;
• and
• at least one memory operatively couple to the at least one computer hardware and having computer executable instructions stored therein which, when executed by the at least one computer processor, cause the at least one computer processor to carry out a method comprising:
• receiving audio sample data corresponding to a specific audio concept;
• generating at least one concept identifier token based on the audio sample data, wherein the at least one concept identifier token represents unique characteristics of the audio sample data;
• adapting a loss function of the diffusion model based on the at least one concept identifier token;
• selecting pivotal parameters in weight matrices in a self-attention layer of the neural network of the AI model based on the audio sample data;
• and
• further training the pivotal parameters of the AI model, to thereby optimize the AI model for the specific audio concept, whereby the diffusion model is able to generate music corresponding to the specific audio concept.