Methods and systems for synthesising speech from text
AssigneeSpotify AB
InventorsFelix Mathew William Chase Vaughan, Harry Alexander Coultas Blum, John Flynn, Zeenat Qureshi
Life of this patent
Estimating the term…
Abstract
A method for synthesising speech from text includes receiving text and encoding, by way of an encoder module, the received text. The method further includes determining, by way of an attention module, a context vector from the encoding of the received text, wherein determining the context vector comprises at least one of: applying a threshold function to an attention vector and accumulating the thresholded attention vector, or applying an activation function to the attention vector and accumulating the activated attention vector. The method further includes determining speech data from the context vector.
Claims18
A computer-implemented method for synthesising speech from text, the method comprising:
- receiving text;
- encoding, by way of an encoder, the received text to obtain an encoding of the received text;
- determining, by way of an attention vector, a context vector from the encoding of the received text, wherein determining the context vector comprises:
- applying a threshold function to the attention vector and accumulating a thresholded attention vector;
- determining speech data from the context vector;
- and
- automatically converting the speech data into an output speech audio waveform.
A non-transitory computer-readable storage medium comprising computer readable code configured to cause a computer to perform a set of operations, comprising:
- receiving text;
- encoding, by way of an encoder, the received text to obtain an encoding of the received text;
- determining, by way of an attention vector, a context vector from the encoding of the received text, wherein determining the context vector comprises:
- applying a threshold function to the attention vector and accumulating a thresholded attention vector;
- determining speech data from the context vector;
- and
- automatically converting the speech data into an output speech audio waveform.
A computer system comprising one or more processors and memory storing instructions, configured to be executed by the one or more processors, to perform a set of operations, comprising:
- receiving text;
- encoding, by way of an encoder, the received text to obtain an encoding of the received text;
- determining, by way of an attention vector, a context vector from the encoding of the received text, wherein determining the context vector comprises:
- applying a threshold function to the attention vector and accumulating a thresholded attention vector;
- determining speech data from the context vector;
- and
- automatically converting the speech data into an output speech audio waveform.
Dependencies are inferred from the claim text.