All deep learning minimum variance distortionless response beamformer for speech separation and enhancement

A computer system for speech recognition, the computer system comprising:

• one or more computer-readable non-transitory storage media configured to store computer program code;
• and
• one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
• receiving code configured to cause the one or more computer processors to receive audio data corresponding to one or more speakers;
• estimating code configured to cause the one or more computer processors to estimate covariance matrices of target speech and noise associated with the received audio data based on a gated recurrent unit-based network (GRU-Net);
• and
• generating code configured to cause the one or more computer processors to generate a predicted target waveform corresponding to a target speaker from among the one or more speakers by a minimum variance distortionless response (MVDR) function based on the estimated covariance matrices, wherein MVDR coefficients are calculated by the GRU-Net.

A non-transitory computer readable medium having stored thereon a computer program for speech recognition, the computer program configured to cause one or more computer processors to:

• receive audio data corresponding to one or more speakers;
• estimate covariance matrices of target speech and noise associated with the received audio data based on a gated recurrent unit-based network (GRU-Net);
• and
• generate a predicted target waveform corresponding to a target speaker from among the one or more speakers by a minimum variance distortionless response (MVDR) function based on the estimated covariance matrices, wherein MVDR coefficients are calculated by the GRU-Net.