Method of operating a hearing aid system and a hearing aid system

A method of operating a hearing aid system comprising the steps of:

• a) providing an audio signal;
• b) passing a frame of the audio signal xt through a neural network encoder and hereby obtaining a latent encoding zt;
• c) manipulating said latent encoding zt to provide a transformed latent encoding zt′ by using at least one of a masking model and a transformation model;
• d) passing said transformed latent encoding zt′ through a neural network decoder and hereby providing a transformed electrical output signal {tilde over (s)}t;
• e) processing said transformed electrical output signal {tilde over (s)}t in order to alleviate a hearing deficit of an individual wearing the hearing aid system and hereby providing a hearing loss compensated electrical output signal {tilde over (s)}t′;
• f) using an electrical-acoustical output transducer of the audio device to generate an acoustical output based on the hearing loss compensated electrical output signal {tilde over (s)}t′.