Speech codec based generative method for speech enhancement in adverse conditions

An apparatus comprising:

• at least one memory configured to store computer program code;
• at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
• receiving code configured to cause the at least one processor to receive an audio signal obtained from a microphone;
• inputting code configured to cause the at least one processor to input the audio signal into a neural-network pipeline, the neural-network pipeline comprising a convolutional network that receives the audio signal and provides a first output of the convolutional network to an enhancer, the enhancer comprising a deep complex convolutional recurrent network that receives the first output along with a mel spectrogram of the audio signal and outputs a second output to at least one of a vocoder and a decoder;
• and
• controlling code configured to cause the at least one processor to control an output of an enhanced audio signal from the at least one of the vocoder and the decoder.

A non-transitory computer readable medium storing a program causing a computer to:

• receive an audio signal obtained from a microphone;
• input the audio signal into a neural-network pipeline, the neural-network pipeline comprising a convolutional network that receives the audio signal and provides a first output of the convolutional network to an enhancer, the enhancer comprising a deep complex convolutional recurrent network that receives the first output along with a mel spectrogram of the audio signal and outputs a second output to at least one of a vocoder and a decoder;
• and
• control an output of an enhanced audio signal from the at least one of the vocoder and the decoder.