Mixed adaptive and fixed coefficient neural networks for speech enhancement

A method comprising:

• receiving, by a first neural network portion of a hybrid neural network system, an input comprising audio data and reference data, the audio data comprising speech data, noise data, and echo data;
• filtering, by the first neural network portion, a portion of the audio data based on adapted coefficients of the first neural network portion, the portion of the audio data comprising at least one of the noise data and/or the echo data, the adapted coefficients comprising coefficients adjusted based on the input and/or an output of the first neural network portion;
• generating, by the first neural network portion based on the filtering of the portion of the audio data, filtered audio data comprising the speech data and an unfiltered portion of at least one of the noise data and/or the echo data;
• and
• extracting, by a second neural network portion of the hybrid neural network system based on the filtered audio data and the reference data, the speech data from the filtered audio data.

A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

• receive, by a first neural network portion of a hybrid neural network system, an input comprising audio data and reference data, the audio data comprising speech data, noise data, and echo data;
• filter, by the first neural network portion, a portion of the audio data based on adapted coefficients of the first neural network portion, the portion of the audio data comprising at least one of the noise data and/or the echo data, the adapted coefficients comprising coefficients adjusted based on the input and/or an output of the first neural network portion;
• generate, by the first neural network portion based on the filtering of the portion of the audio data, filtered audio data comprising the speech data and an unfiltered portion of at least one of the noise data and/or the echo data;
• and
• extract, by a second neural network portion of the hybrid neural network system based on the filtered audio data and the reference data, the speech data from the filtered audio data.