Audio packet loss compensation method and apparatus and electronic device

An apparatus for audio packet loss compensation processing, comprising:

• a memory configured to store a program;
• and
• one or more processors configured to run the program stored in the memory, to execute operations comprising:
• acquiring a time domain signal and a frame state of a current audio frame;
• in response to the frame state being a lost state:
• predicting the time domain signal of the current audio frame by using an audio prediction model according to time domain signals of a first number of existing audio frames before the current audio frame by:
• generating acoustic features of the existing audio frames;
• carrying out, by a one-dimensional convolutional network, semantic feature extraction on the time domain signals of the first number of the existing audio frames, and carrying out, by a GRU network, semantic understanding based on the extracted semantic features to generate semantic expressions at a phoneme level corresponding to the existing audio frames;
• predicting the time domain signal of the current audio frame according to the acoustic features and the semantic expressions;
• and
• outputting a prediction result as the current audio frame, and performing audio packet loss compensation using the predicted time domain signal;
• or
• in response to the frame state is an intact state:
• training the audio prediction model by using the time domain signal of the current audio frame and the time domain signals of the first number of the existing audio frames before the current audio frame as training data;
• updating the audio prediction model;
• and
• outputting the current audio frame in the intact state.

An electronic device, comprising:

• a memory configured to store a program;
• and
• one or more processors configured to run the program stored in the memory to cause the electronic device to perform operations comprising:
• acquiring time domain signals of a first number of existing audio frames in a case that an audio packet loss occurs;
• carrying out acoustic feature extraction on the time domain signals of the first number of the existing audio frames to generate acoustic features of the existing audio frames;
• carrying out, by a one-dimensional convolutional network, semantic feature extraction on the time domain signals of the first number of the existing audio frames, and carrying out, by a GRU network, semantic understanding based on the extracted semantic features to generate semantic expressions at a phoneme level corresponding to the existing audio frames;
• predicting a time domain signal of a current audio frame according to the acoustic features and the semantic expressions, for audio packet loss compensation;
• and
• performing the audio packet loss compensation using the predicted time domain signal.