System and method for speech processing

A non-transitory computer-readable storage medium storing one or more programs configured for execution by a computer system, the one or more programs comprising a set of operations, including:

• receiving training data for training a speech synthesis model, the training data comprising speech that corresponds to known text;
• training the speech synthesis model;
• testing the speech synthesis model using a plurality of text sequences including, for each text sequence of the plurality of text sequences:
• calculating a plurality of metrics, each of the plurality of metrics indicating a performance of the speech synthesis model when synthesizing each text sequence, wherein the plurality of metrics comprises a first metric derived from an output of the speech synthesis model and a second metric that is based on an evaluation of an intermediate output of the speech synthesis model;
• determining whether further training is needed for each of the plurality of metrics;
• determining targeted training text, wherein the targeting training text is text related to text sequences where at least one of the plurality of metrics indicated that the speech synthesis model required further training;
• and
• outputting the determined targeted training text with a request for speech corresponding to the targeted training text;
• wherein the speech synthesis model comprises an attention network and the second metric that is based on the evaluation of the intermediate output is derived from the attention network for an input sentence.

A system for training a speech synthesis model, the system comprising a processor and memory, the speech synthesis model being stored in memory and being adapted to output speech in response to input text, the processor being adapted to perform a set of operations, comprising:

• receiving training data for training the speech synthesis model, the training data comprising speech that corresponds to known text;
• training the speech synthesis model;
• testing the speech synthesis model using a plurality of text sequences including, for each text sequence of the plurality of text sequences:
• calculating a plurality of metrics, each of the plurality of metrics indicating a performance of the speech synthesis model when synthesizing each text sequence, wherein the plurality of metrics comprises a first metric derived from an output of the speech synthesis model and a second metric that is based on an evaluation of an intermediate output of the speech synthesis model;
• determining whether further training is needed for each of the plurality of metrics;
• determining targeted training text, wherein the targeting training text is text related to text sequences where at least one of the plurality of metrics indicated that the speech synthesis model required further training;
• and
• outputting the determined targeted training text with a request for speech corresponding to the targeted training text;
• wherein the speech synthesis model comprises an attention network and the second metric that is based on the evaluation of the intermediate output is derived from the attention network for an input sentence.