Systems and methods for synthesizing speech
AssigneeZhejiang Tonghuashun Intelligent Technology Co., Ltd.
InventorsPeng ZHANG, Xinhui HU, Xinkang XU, Jian LU
Life of this patent
Estimating the term…
Abstract
The present disclosure discloses a method for synthesizing a speech. The method includes generating the speech based on a text with a speech synthesis model, wherein the speech synthesis model includes an embedding layer, a speech synthesis layer, and a position layer; and training the speech synthesis model when an evaluation index meets a preset condition, wherein the evaluation index includes one or more quality indexes determined based on at least a part of the text and at least a part of the speech.
Claims20
A method, that is implemented on a computing device having at least one processor and at least one storage medium including a set of instructions for synthesizing a speech, comprising:
- generating the speech based on a text with a speech synthesis model, wherein the speech synthesis model is configured to output the speech corresponding to the text and a stop token indicating where the speech should stop;
- obtaining an evaluation index, wherein the evaluation index includes a second effect score of the speech synthesis model, and the second effect score is generated based on at least one of a duration of the speech and a correct ending position of a sentence corresponding to the speech;
- and
- training the speech synthesis model when the evaluation index meets a preset condition.
A system for synthesizing a speech, comprising:
- at least one storage medium including a set of instructions;
- and
- at least one processor in communication with the at least one storage medium;
- wherein when executing the set of instructions, the at least one processor is configured to direct the system to perform operations including:
- generating the speech based on a text with a speech synthesis model, wherein the speech synthesis model is configured to output the speech corresponding to the text and a stop token indicating where the speech should stop;
- obtaining an evaluation index, wherein the evaluation index includes a second effect score of the speech synthesis model, and the second effect score is generated based on at least one of a duration of the speech and a correct ending position of a sentence corresponding to the speech;
- and
- training the speech synthesis model when the evaluation index meets a preset condition.
A non-transitory computer-readable storage medium, comprising instructions that, when executed by at least one processor, direct the at least processor to perform a method for synthesizing a speech, the method comprising:
- generating the speech based on a text with a speech synthesis model, wherein the speech synthesis model is configured to output the speech corresponding to the text and a stop token indicating where the speech should stop;
- obtaining an evaluation index, wherein the evaluation index includes a second effect score of the speech synthesis model, and the second effect score is generated based on at least one of a duration of the speech and a correct ending position of a sentence corresponding to the speech;
- and
- training the speech synthesis model when the evaluation index meets a preset condition.
Dependencies are inferred from the claim text.