Learnable speed control for speech synthesis
AssigneeTencent America LLC
InventorsChengzhu YU, Dong YU
Life of this patent
Estimating the term…
Abstract
A method, computer program, and computer system is provided for synthesizing speech at one or more speeds. A context associated with one or more phonemes corresponding to a speaking voice is encoded, and the one or more phonemes are aligned to one or more target acoustic frames based on the encoded context. One or more mel-spectrogram features are recursively generated from the aligned phonemes and target acoustic frames, and a voice sample corresponding to the speaking voice is synthesized using the generated mel-spectrogram features.
Claims20
A method of synthesizing speech at one or more speeds, comprising:
- encoding, by a computer, a context associated with one or more phonemes corresponding to a speaking voice;
- aligning, by the computer, the one or more phonemes to one or more target acoustic frames based on the encoded context;
- recursively generating, by the computer, one or more mel-spectrogram features from the aligned phonemes and the target acoustic frames;
- and
- synthesizing, by the computer, a voice sample at a given speed corresponding to the speaking voice using the generated mel-spectrogram features.
A computer system for synthesizing speech at one or more speeds, the computer system comprising:
- one or more computer-readable non-transitory storage media configured to store computer program code;
- and
- one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
- encoding code configured to cause the one or more computer processors to encode a context associated with one or more phonemes corresponding to a speaking voice;
- aligning code configured to cause the one or more computer processors to align the one or more phonemes to one or more target acoustic frames based on the encoded context;
- generating code configured to cause the one or more computer processors to recursively generate one or more mel-spectrogram features from the aligned phonemes and the target acoustic frames;
- and
- synthesizing code configured to cause the one or more computer processors to synthesize a voice sample at a given speed corresponding to the speaking voice using the generated mel-spectrogram features.
A non-transitory computer readable medium having stored thereon a computer program for synthesizing speech at one or more speeds, the computer program configured to cause one or more computer processors to:
- encode a context associated with one or more phonemes corresponding to a speaking voice;
- align the one or more phonemes to one or more target acoustic frames based on the encoded context;
- recursively generate one or more mel-spectrogram features from the aligned phonemes and the target acoustic frames;
- and
- synthesize a voice sample at a given speed corresponding to the speaking voice using the generated mel-spectrogram features.
Dependencies are inferred from the claim text.