Speech-driven animation method and apparatus based on artificial intelligence

A speech-driven animation apparatus, deployed on an audio and video processing device, the apparatus comprising a processor and a memory, the memory being configured to store program code and transmit the program code to the processor;

• and when executing the program code, the processor being configured to:
• obtain a first speech with an acoustic feature, the first speech comprising a plurality of speech frames;
• determine linguistics information corresponding to a speech frame in the first speech by applying a neural network mapping model to extract the acoustic feature, the linguistics information being used for identifying a distribution possibility that the speech frame in the first speech pertains to phonemes;
• determine an expression parameter corresponding to the speech frame in the first speech according to the linguistics information, wherein the expression parameters do not reflect pronunciation habits of different speakers;
• and
• enable according to the expression parameter, an animation character to make an expression corresponding to the first speech.

A non-transitory computer-readable storage medium, configured to store program code, the program code, when being executed by a processor, causing the processor to perform:

• obtaining a first speech with an acoustic feature, the first speech comprising a plurality of speech frames;
• determining linguistics information corresponding to a speech frame in the first speech by applying a neural network mapping model to extract the acoustic feature, the linguistics information being used for identifying a distribution possibility that the speech frame in the first speech pertains to phonemes;
• determining an expression parameter corresponding to the speech frame in the first speech according to the linguistics information, wherein the expression parameters do not reflect pronunciation habits of different speakers;
• and
• enabling, according to the expression parameter, an animation character to make an expression corresponding to the first speech.