Back to results
US 12,573,372 B2Granted
Text-to-speech system with variable frame rate
AssigneeSoundHound AI IP, LLC
InventorsSteve Pearson, Jon Grossman
Life of this patent
Estimating the term…
Abstract
A neural TTS system is trained to generate key acoustic frames at variable rates while omitting other frames. The frame skipping depends on the acoustic features to be generated for the input text. The TTS system can interpolate frames between the key frames at a target rate for a vocoder to synthesis audio samples.
Claims16
A computer-implemented method of speech synthesis, the method comprising:
- receiving a sequence of symbols;
- and
- synthesizing from the sequence of symbols, by a speech synthesis model, a plurality of key frames based on an average key frame rate input, wherein a key frame comprises at least one interpolation parameter indicating the ratio of the number of the plurality of key frames and one or more skipped frames is associated with the average key frame rate input.
A computer-implemented method of speech synthesis, the method comprising:
- receiving, at a speech synthesis model, a sequence of symbols for speech synthesis;
- synthesizing a plurality of key frames based on an average key frame rate input, wherein a key frame comprises at least one interpolation parameter indicating the ratio of the number of the plurality of key frames and the one or more skipped frames is associated with the average key frame rate input;
- interpolating, by an interpolation model, one or more interpolated frames based on the plurality of key frames and the at least one interpolation parameter;
- and
- generating, by a vocoder model, speech waveforms of the sequence of symbols based on the plurality of key frames and the one or more interpolated frames.
2 more elements
A computer-implemented method of speech synthesis, the method comprising:
- receiving, at a speech synthesis model, a sequence of symbols for speech synthesis;
- synthesizing a plurality of key frames based on an average key frame rate input, wherein a key frame comprises at least one interpolation parameter indicating the ratio of the number of the plurality of key frames and the one or more skipped frames is associated with the average key frame rate input;
- interpolating, by a vocoder model, one or more interpolated frames based on the plurality of key frames and the at least one interpolation parameter;
- and
- generating, by the vocoder model, speech waveforms of the sequence of symbols based on the plurality of key frames and the one or more interpolated frames.
2 more elements
Dependencies are inferred from the claim text.