Multi-scale spectrogram text-to-speech

A computer-implemented method comprising:

• receiving a request to generate audio from input text;
• generating audio from the input text by:
• generating a first number of vectors from phoneme embeddings representing the input text,
• predicting one or more spectrograms having the first number of frames using multiple scales wherein a coarser scale influences a finer scale,
• concatenating the first number of vectors and the predicted one or more spectrograms,
• generating at least one mel spectrogram from the concatenated vectors and the predicted one or more spectrograms, and
• converting, with a vocoder, the at least one mel spectrogram frames to audio;
• and
• outputting the generated audio according to the request.

A system comprising:

• a first one or more electronic devices to implement a vocoder in a multi-tenant provider network;
• and
• a second one or more electronic devices to implement an acoustic model in the multi-tenant provider network, the acoustic model including instructions that upon execution cause the acoustic model to:
• receive a request to generate audio from input text;
• generate audio from the input text by:
• generating a first number of vectors from phoneme embeddings representing the input text,
• predicting one or more spectrograms having the first number of frames using multiple scales wherein a coarser scale influences a finer scale,
• concatenating the first number of vectors and the predicted one or more spectrograms,
• generating at least one mel spectrogram from the concatenated vectors and the predicted one or more spectrograms, and
• converting, with the vocoder, the at least one mel spectrogram frames to audio;
• and
• outputting the generated audio according to the request.