Speech recognition method and apparatus, and computer-readable storage medium

A speech recognition method, performed by a computer device, the method comprising:

• obtaining a target speech stream;
• extracting an enhanced spectrum of each audio frame of the target speech stream based on a speech separation and enhancement model;
• performing auditory matching on the enhanced spectrum based on a representation model to obtain a representation feature, wherein the representation model is obtained by performing back propagation based on a first loss function of a speech recognition model to train an intermediate model bridging between the speech separation and enhancement model and the speech recognition model;
• and
• recognizing the representation feature based on the speech recognition model, to obtain a phoneme corresponding to each audio frame,
• wherein the speech separation and enhancement model, the representation model, and the speech recognition model comprises neural networks with network parameters obtained by joint training by iteratively minimizing a fused loss function of the first loss function and a second loss function of the speech separation and enhancement model.

A speech recognition device, comprising a memory for storing computer instructions and a processor for executing the computer instructions to:

• obtain a first loss function of a speech separation and enhancement model and a second loss function of a speech recognition model;
• perform back propagation based on the second loss function to train an intermediate model bridging between the speech separation and enhancement model and the speech recognition model, to obtain a representation model;
• fuse the first loss function and the second loss function using a machine learning algorithm, to obtain a target loss function;
• and
• jointly train the speech separation and enhancement model, the representation model, and the speech recognition model based on the target loss function, and ending the joint training when a preset convergence condition is met.