System and method for outlier identification to remove poor alignments in speech synthesis
AssigneeInteractive Intelligence Group, Inc.
InventorsE. Veera Raghavendra, Aravind Ganapathiraju
Life of this patent
Estimating the term…
Abstract
A system and method are presented for outlier identification to remove poor alignments in speech synthesis. The quality of the output of a text-to-speech system directly depends on the accuracy of alignments of a speech utterance. The identification of mis-alignments and mis-pronunciations from automated alignments may be made based on fundamental frequency methods and group delay based outlier methods. The identification of these outliers allows for their removal, which improves the synthesis quality of the text-to-speech system.
Claims31
A method for identifying outlying results in audio files used for model training, in a text-to-speech system, applying fundamental frequency, the method comprising the steps of:
- a. extracting values of the fundamental frequencies from the audio files;
- b. generating alignments using the extracted values from the audio files;
- c. separating out instances of phonemes;
- d. determining, for each separated instance, an average fundamental frequency value and an average duration value;
- e. identifying an instance as an outlier, wherein an outlier is identified if:
- i. the phoneme is a vowel;
- ii. the average fundamental frequency of an instance is less than a predetermined value;
- iii. the duration of the instance is greater than twice the average duration of a phoneme;
- and
- iv. the duration of the instance is less than half of the average duration of a phoneme;
- and
- f. identifying a sum of outliers for each sentence in the audio files, wherein if the sentence has more than a number of outliers, discarding the sentence in the audio files from model training.
A method for identifying outlying results in audio files used for model training, in a text-to-speech system, applying group delay algorithms, the method comprising the steps of:
- a. generating alignments of the audio files at a phoneme level;
- b. generating alignments of the audio files at a syllable level;
- c. adjusting the alignments at the syllable level using group delay algorithms;
- d. separating each syllable from the audio files into a separate audio file;
- e. generating, for each separate audio file, phonemes of the separate audio files using phoneme boundaries for each syllable and an existing phoneme model;
- f. determining a likelihood value of each generated phoneme, wherein if the likelihood value meets a criteria, identifying the generated phoneme as an outlier;
- and
- g. identifying a sum of outliers for each sentence in the audio files, wherein if the sentence has more than a number of outliers, discarding the sentence from model training.
A method for synthesizing speech in a text-to-speech system, wherein the system comprises at least a speech database, a database capable of storing Hidden Markov Models, and a synthesis filter, the method comprising the steps of:
- a. identifying outlying results in audio files from the speech database and removing the outlying results before model training;
- b. converting a speech signal from the speech database into parameters and extracting the parameters from the speech signal;
- c. training Hidden Markov Models using the extracted parameters from the speech signal and using the labels from the speech database to produce context dependent Hidden Markov Models;
- d. storing the context dependent Hidden Markov Models in the database capable of storing Hidden Markov Models;
- e. inputting text and analyzing the text, wherein said analyzing comprises extracting labels from the text;
- f. utilizing said labels to generate parameters from the context dependent Hidden Markov Models;
- g. generating an other signal from the parameters;
- h. inputting the other signal and the parameters into the synthesis filter;
- and
- i. producing synthesized speech as the other signal passes through the synthesis filter.
Dependencies are inferred from the claim text.