Innovative karaoke sound system with combined neural network feedback suppression and coded vocal restoration

An apparatus for target vocal enhancement, the apparatus comprising:

• at least one memory configured to store computer program code;
• at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
• receiving code configured to cause the at least one processor to receive an audio signal obtained from a microphone;
• inputting code configured to cause the at least one processor to input the audio signal into frequency-domain Kalman filter (FDKF);
• further inputting code configured] to cause the at least one processor to input the audio signal and an output from the FDKF into a neural network;
• estimating code configured to cause the at least one processor to estimate, based on the audio signal and the output from the FDKF, and generating an output from the neural network by removing feedback signals from the audio signal by the neural network;
• recovering code configured to cause the at least one processor to recover, by a codec receiving the output from the neural network, vocal quality of a target vocal signal by performing, to the output from the neural network and of which the feedback signals from the audio signal have been removed by the neural network, de-reverberation and quality restoration of the target vocal signal;
• and
• outputting code configured to cause the at least one processor to output a version of the audio signal in which the target vocal signal is enhanced by removal of the feedback signals from the audio signal by the neural network and by recovery of the vocal quality by the codec.

A non-transitory computer readable medium storing a program causing a computer to:

• receive an audio signal obtained from a microphone;
• input the audio signal into frequency-domain Kalman filter (FDKF);
• input the audio signal and an output from the FDKF into a neural network;
• estimate, based on the audio signal and the output from the FDKF, and generate an output from the neural network by removing feedback signals from the audio signal by the neural network;
• recover, by a codec receiving the output from the neural network, vocal quality of a target vocal signal by performing, to the output from the neural network and of which the feedback signals from the audio signal have been removed by the neural network, de-reverberation and quality restoration of the target vocal signal;
• and
• output a version of the audio signal in which the target vocal signal is enhanced by removal of the feedback signals from the audio signal by the neural network and by recovery of the vocal quality by the codec.