Synthesizing phoneme string of predetermined duration by adjusting initial phoneme duration on values from multiple regression by adding values based on their standard deviations
Statistical data including an average value, a standard deviation, and a minimum value of a phoneme duration of each phoneme is stored in a memory. When speech production time is determined for a phoneme string in a predetermined expiratory paragraph, the total phoneme duration of the phoneme string is set so as to become equal to the speech production time. Based on the set phoneme duration, phonemes are connected and a speech waveform is generated. To set a phoneme duration for each phoneme, a phoneme duration initial value is first set based on an average value, obtained by equally dividing the speech production time by phonemes of the phoneme string, and a phoneme duration range, phoneme. Then, set based on statistical data of each the phoneme duration initial value is adjusted based on the statistical data and the speech production time.
Drawings
Claims19
A speech synthesizing apparatus for performing speech synthesis according to an inputted phoneme string, comprising:
storage means for storing statistical data, which comprises at least standard deviation data and multiple regression analysis data, related to a phoneme duration of each phoneme;
determining means for determining the speech production time for the inputted phoneme string;
first initial value obtaining means for obtaining an estimated duration with respect to each phoneme by a multiple regression analysis using the multiple regression anaylsis data stored in said storing means;
setting means for setting an initial phoneme duration for each phoneme constructing the phoneme string based on the estimated duration;
calculating means for calculating a phoneme production time for each phoneme by adding a value calculated based on the standard deviation data of the phoneme which is obtained from said storage and the initial phoneme duration set for the phoneme, wherein the individual phoneme production times are determined so as to add up to the speech production time determined by said determination means;
and
generating means for generating a speech waveform by connecting phonemes having the calculated phoneme production time.
4 more elements
A speech synthesizing method of performing speech synthesis according to an inputted phoneme string, comprising the steps of:
determining the speech production time of the inputted phoneme string in a predetermined section;
obtaining an estimated duration with respect to each phoneme by a multiple regression analysis using multiple regression anaylsis data stored in storing means;
setting an initial phoneme duration for each phoneme constructing the phoneme string based on the estimated duration;
calculating a phoneme production time for each phoneme by adding a value calculated based on a standard deviation data of the phoneme which is obtained from storage means for storing statistical data, which comprises at least standard deviation data and the multiple regression analysis data related to the phoneme duration of each phoneme and the initial phoneme duration set for the phoneme, wherein the individual phoneme production times are determined so as to add up to the speech production time determined by said determining step;
and
generating a speech waveform by connecting phonemes having the calculated phoneme production time.
3 more elements
A storage medium storing a control program for instructing a computer to perform a speech synthesizing process for performing speech synthesis according to an inputted phoneme string, said control program comprising:
codes for instructing the computer to determine the speech production time for the inputted phoneme string;
codes for obtaining an estimated duration with respect to each phoneme by a multiple regression analysis using multiple regression analysis data stored in storing means;
codes for instructing the computer to set an initial phoneme duration for each phoneme constructing the phoneme string based on the estimated duration;
calculating the phoneme production time for each phoneme by adding a value calculated based on the standard deviation data of the phoneme which is obtained from the storage means for storing statistical data, which comprises at least standard deviation data and the multiple regression analysis data, related to the phoneme duration of each phoneme and the initial phoneme duration set for the phoneme, wherein the individual phoneme production times are determined so as to add up to the speech production time determined by said computer in response to the codes for instructing the computer to determine the speech production time for the inputted phoneme string;
and
codes for instructing the computer to generate a speech waveform by connecting phonemes having the calculated phoneme production time.
9 Mar 2019Estimated · howhide20 years from earliest known nonprovisional domestic filing. Maintenance-fee lapses, terminal disclaimers and statutory extensions have not been checked. The continuity chain may be incomplete; this is not an enforceability determination. Patent term adjustment is unavailable; no adjustment was added.
USPTO file history isn’t available for this patent, so only indexed dates are shown.
Description7,587 words
Summary602 words
#The present invention relates to a method and an apparatus for speech synthesis utilizing a rule-based synthesis method, and a storage medium storing computer-readable programs for realizing the speech synthesizing method.
#As a method of controlling a phoneme duration, a conventional rule-based speech synthesizing apparatus employs a control-rule method determined based on statistics related to a phoneme duration (Yoshinori SAGISAKA, Youichi TOUKURA, “Phoneme Duration Control for Rule-Based Speech Synthesis,” The Journal of the Institute of Electronics and Communication Engineers of Japan, vol. J67-A, No. 7 (1984) pp 629-636), or a method of employing Categorical Multiple Regression as a technique of multiple regression analysis (Tetsuya SAKAYORI, Shoichi SASAKI, Hiroo KITAGAWA, “Prosodies Control Using Categorical Multiple Regression for Rule-Based Synthesis,” “Report of the 1986 Autumn Meeting of the Acoustic Society of Japan,” 3-4-17 (1986-10)).
#However, according to the above conventional technique, it is difficult to specify the speech production time of a phoneme string. For instance, in the control-rule method, it is difficult to determine a control rule that corresponds to a specified speech-production time. Moreover, if input data includes an exception in the control rule method, or if a satisfactory estimation value is not obtained in the method of Categorical Multiple Regression, it becomes difficult to obtain a phoneme duration that sounds natural.
Brief description of the drawings9 figures
#The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the description, serve to explain the principles of the invention.
#FIG. 1 is a block diagram showing a construction of a speech synthesizing apparatus according to an embodiment of the present invention;
#FIG. 2 is a block diagram showing a flow structure of the speech synthesizing apparatus according to the embodiment of the present invention;
Detailed description6,762 words
#Preferred embodiments of the present invention will be described in detail in accordance with the accompanying drawings.
#FIG. 1 is a block diagram showing the construction of a speech synthesizing apparatus according to a first embodiment of the present invention. Reference numeral 101 denotes a CPU which performs various controls in the rule-based speech synthesizing apparatus of the present embodiment. Reference numeral 102 denotes a ROM where various parameters and control programs executed by the CPU 101 are stored. Reference numeral 103 denotes a RAM which stores control programs executed by the CPU 101 and serves as a work area of the CPU 101. Reference numeral 104 denotes an external memory such as hard disk, floppy disk, CD-ROM and the like. Reference numeral 105 denotes an input unit comprising a keyboard, a mouse and so forth. Reference numeral 106 denotes a display for performing various display according to the control of the CPU 101. Reference numeral 6 denotes a speech synthesizer for generating synthesized speech. Reference numeral 107 denotes a speaker where speech signals (electric signals) outputted by the speech synthesizer 6 are converted to sound and outputted.
#FIG. 2 is a block diagram showing a flow structure of the speech synthesizing apparatus according to the first embodiment. Functions to be described below are realized by the CPU 101 executing control programs stored in the ROM 102 or executing control programs loaded from the external memory 104 to the RAM 103.