Method, apparatus, storage medium, and electronic device for speech synthesis

A non-transitory computer-readable medium having a computer program stored thereon, the program, when executed by a processing apparatus, execute operations comprising:

• acquiring a text to be synthesized marked with stress words;
• inputting the text to be synthesized into a speech synthesis model to obtain audio information corresponding to the text to be synthesized, the speech synthesis model being obtained by training on sample texts marked with stress words and sample audios corresponding to the sample texts, wherein the stress words marked in the sample texts are determined by:
• acquiring a plurality of sample texts each of which includes stress words with initial stress labels,
• for each of the stress words marked with the initial stress label, if the stress word is marked as a stress word in each of the sample texts, adding a target stress label to the stress word;
• if the stress word is marked as a stress word in at least two of the sample texts, in a case that the fundamental frequency of the stress word is greater than a preset fundamental frequency threshold and the energy of the stress word is greater than a preset energy threshold, adding a target stress label to the stress word,
• determining stress words to each of which the target stress label has been added as the stress words marked in the sample texts;
• and
• generating, by the speech synthesis model, the audio information corresponding to the text to be synthesized based on a sequence of phonemes corresponding to the text and stress labels corresponding to the stress words marked in the text, wherein the generating audio information corresponding to the text to be synthesized based on the sequence of phonemes and the stress labels comprises:
• vectorizing the sequence of phonemes corresponding to the text to be synthesized to obtain a phoneme vector,
• vectorizing the stress labels to obtain a stress label vector,
• determining a target phoneme vector according to the phoneme vector and the stress label vector,
• determining a Mel spectrum according to the target phoneme vector, and
• inputting the Mel spectrum into a vocoder to obtain the audio information corresponding to the text to be synthesized.

An electronic device, comprising:

• a storage apparatus having computer programs stored thereon;
• a processing apparatus configured to execute the computer programs in the storage apparatus, so as to execute operations comprising:
• acquiring a text to be synthesized marked with stress words;
• inputting the text to be synthesized into a speech synthesis model to obtain audio information corresponding to the text to be synthesized, the speech synthesis model being obtained by training on sample texts marked with stress words and sample audios corresponding to the sample texts, wherein the stress words marked in the sample texts are determined by:
• acquiring a plurality of sample texts each of which includes stress words with initial stress labels,
• for each of the stress words marked with the initial stress label, if the stress word is marked as a stress word in each of the sample texts, adding a target stress label to the stress word;
• if the stress word is marked as a stress word in at least two of the sample texts, in a case that the fundamental frequency of the stress word is greater than a preset fundamental frequency threshold and the energy of the stress word is greater than a preset energy threshold, adding a target stress label to the stress word,
• determining stress words to each of which the target stress label has been added as the stress words marked in the sample texts;
• and
• generating, by the speech synthesis model, the audio information corresponding to the text to be synthesized based on a sequence of phonemes corresponding to the text and stress labels corresponding to the stress words marked in the text, wherein the generating audio information corresponding to the text to be synthesized based on the sequence of phonemes and the stress labels comprises:
• vectorizing the sequence of phonemes corresponding to the text to be synthesized to obtain a phoneme vector,
• vectorizing the stress labels to obtain a stress label vector,
• determining a target phoneme vector according to the phoneme vector and the stress label vector,
• determining a Mel spectrum according to the target phoneme vector, and
• inputting the Mel spectrum into a vocoder to obtain the audio information corresponding to the text to be synthesized.