Artificial intelligence-based animation character drive method and related apparatus

A computing device comprising a processor and a memory coupled to the processor, wherein the memory stores a plurality of computer programs that, when executed by the processor, cause the computing device to perform a plurality of operations including:

• obtaining simultaneously captured multi-modal media data including a facial expression and a corresponding speech of a speaker;
• determining a first expression base of a first animation character corresponding to the speaker according to the facial expression;
• determining, according to the media data and the first expression base, an acoustic feature and a target expression parameter of the first animation character speaking target text information, the acoustic feature characterizing a sound of the speaker when speaking the target text information, and the target expression parameter characterizing a facial expression of the speaker when speaking the target text information based on the first expression base;
• determining a mapping relationship between the first expression base of the first animation character and the second expression base of the second animation character, wherein an expression parameter of the first expression base is a function of an expression parameter of the second expression base;
• and
• driving a second animation character having a second expression base to simulate a sound of the speaker speaking the target text information based on the acoustic feature and a facial expression of the second animation character based on the mapping relationship, the target expression parameter and the second expression base simultaneously.

A non-transitory computer-readable storage medium storing a plurality of computer programs that, when executed by a processor of a computing device, cause the computing device to perform a plurality of operations including:

• obtaining simultaneously captured multi-modal media data including a facial expression and a corresponding speech of a speaker;
• determining a first expression base of a first animation character corresponding to the speaker according to the facial expression;
• determining, according to the media data and the first expression base, an acoustic feature and a target expression parameter of the first animation character speaking target text information, the acoustic feature characterizing a sound of the speaker when speaking the target text information, and the target expression parameter characterizing a facial expression of the speaker when speaking the target text information based on the first expression base;
• determining a mapping relationship between the first expression base of the first animation character and the second expression base of the second animation character, wherein an expression parameter of the first expression base is a function of an expression parameter of the second expression base;
• and
• driving a second animation character having a second expression base to simulate a sound of the speaker speaking the target text information based on the acoustic feature and a facial expression of the second animation character based on the mapping relationship, the target expression parameter and the second expression base simultaneously.