Generative adversarial network based audio restoration

A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to implement a generative adversarial network (GAN) based restoration system that operates to:

• train a first neural network, of a generator of the GAN based restoration system, to generate an artificial audio spectrogram having a target damage characteristic based on an input audio spectrogram and a target damage vector, thereby generating a trained generator;
• input, to the trained generator, an original audio recording spectrogram corresponding to an original audio recording and an input target damage vector;
• process, by the trained generator, the original audio recording spectrogram to generate an artificial audio recording spectrogram having a level of damage corresponding to the input target damage vector;
• and
• convert, by a spectrogram inversion module of the GAN based restoration system, the artificial audio recording spectrogram to an artificial audio recording waveform output.

An apparatus comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, causes the processor to implement a generative adversarial network (GAN) based restoration system that operates to:
• train a first neural network, of a generator of the GAN based restoration system, to generate an artificial audio spectrogram having a target damage characteristic based on an input audio spectrogram and a target damage vector, thereby generating a trained generator;
• input, to the trained generator, an original audio recording spectrogram corresponding to an original audio recording and an input target damage vector;
• process, by the trained generator, the original audio recording spectrogram to generate an artificial audio recording spectrogram having a level of damage corresponding to the input target damage vector;
• and
• convert, by a spectrogram inversion module of the GAN based restoration system, the artificial audio recording spectrogram to an artificial audio recording waveform output.