Synthesis of speech from text in a voice of a target speaker using neural networks

A computer-implemented method comprising:

• obtaining an audio representation of speech of a target speaker;
• obtaining input text for which speech is to be synthesized in a voice of the target speaker;
• generating a speaker embedding vector by:
• providing a plurality of overlapping sliding windows of the audio representation to a speaker verification neural network to generate a plurality of individual vector embeddings, the speaker verification neural network trained to distinguish speakers from one another;
• and
• generating the speaker embedding vector by computing an average of the individual vector embeddings;
• generating an audio representation of the input text spoken in the voice of the target speaker by providing the input text and the speaker embedding vector to a spectrogram generation neural network that is trained using voices of reference speakers to generate audio representations;
• and
• providing the audio representation of the input text spoken in the voice of the target speaker for output.