Using speech to text data in training text to speech models
AssigneeInternational Business Machines Corporation
InventorsAndrew R. Freed, Vamshi Krishna Thotempudi, Sujatha B. Perepa
Life of this patent
Estimating the term…
Abstract
A system and method for providing a text to speech output by receiving user audio data, determining a user region-specific-pronunciation classification according to the audio data, determining text for a response to the user according to the audio data, identifying a portion from the text, where a region specific-pronunciation dictionary includes the portion, and using a phoneme string, from the dictionary selected according to the user region-specific pronunciation classification, for the word in a text to speech output to the user.
Claims20
A computer implemented method for providing a text to speech output, the method comprising:
- receiving user audio data;
- determining, by the one or more computer processors, a string of text corresponding to the user audio data;
- determining, by the one or more computer processors, a string of phonemes corresponding to the user audio data;
- determining, by one or more computer processors, a user region-specific-pronunciation classification according to the string of phonemes;
- determining, by the one or more computer processors, text for a response to the user according to the string of text;
- identifying, by the one or more computer processors, a portion from the text for a response, wherein a region specific-pronunciation dictionary comprises the portion;
- using, by the one or more computer processors, a phoneme string, from the region-specific-pronunciation dictionary selected according to the user region-specific pronunciation classification, for the portion in a text to speech output to the user;
- and
- providing an audio text to speech output including the portion to the user using a system speaker.
A computer program product for providing a text to speech output, the computer program product comprising one or more computer readable storage devices and collectively stored program instructions on the one or more computer readable storage devices, the stored program instructions comprising:
- program instructions to receive user audio data;
- program instructions to determine a string of text corresponding to the user audio data;
- program instructions to determine a string of phonemes corresponding to the user audio data;
- program instructions to determine a user region-specific-pronunciation classification according to the string of phonemes;
- program instructions to determine text for a response to the user according to the string of text;
- program instructions to identify a portion from the text for a response, wherein a region-specific-pronunciation dictionary comprises the portion;
- program instructions to use a phoneme string, from the region-specific-pronunciation dictionary selected according to the user region-specific pronunciation classification, for the portion in a text to speech output to the user;
- and
- program instructions to provide an audio text to speech output including the portion, to the user using a system speaker.
A computer system for providing a text to speech output, the computer system comprising:
- one or more computer processors;
- one or more computer readable storage devices;
- and
- stored program instructions on the one or more computer readable storage devices for execution by the one or more computer processors, the stored program instructions comprising:
- program instructions to receive user audio data;
- program instructions to determine a string of text corresponding to the user audio data;
- program instructions to determine a string of phonemes corresponding to the user audio data;
- program instructions to determine a user region-specific-pronunciation classification according to the string of phonemes;
- program instructions to determine text for a response to the user according to the string of text;
- program instructions to identify a portion from the text for a response, wherein a region-specific-pronunciation dictionary comprises the portion;
- program instructions to use a phoneme string, from the region-specific-pronunciation dictionary selected according to the user region-specific pronunciation classification, for the portion in a text to speech output to the user;
- and
- program instructions to provide an audio text to speech output including the portion, to the user using a system speaker.
Dependencies are inferred from the claim text.