Method and system for synthesizing cross-lingual speech
AssigneeSpeech Morphing Systems, Inc.
InventorsDarko PEKAR, Radovan Obradovic
Life of this patent
Estimating the term…
Abstract
A method for synthesizing cross-lingual speech includes receiving a request for synthesizing speech, the request for synthesizing speech including a target text document and a target language. Phonetic transcriptions are generated for the target text document. Prosodic annotations for the target text document are generated based on the target text document and the target language. Phone durations and acoustic features are generated based on the phonetic transcriptions and the prosodic annotations using a neural network. A speech corresponding to the target text document in the target language is synthesized based on the generated phone durations and acoustic features.
Claims20
A method for synthesizing cross-lingual speech, executed by a processor, the method comprising:
- receiving a request for synthesizing speech, wherein the request for synthesizing speech comprises a target text document and a target language;
- generating phonetic transcriptions for the target text document;
- generating prosodic annotations for the target text document based on the target text document and the target language;
- generating phone durations and acoustic features based on the phonetic transcriptions and the prosodic annotations using a neural network;
- and
- synthesizing a speech corresponding to the target text document in the target language based on the generated phone durations and acoustic features.
A apparatus for synthesizing cross-lingual speech, the apparatus comprising:
- at least one memory configured to store program code;
- and
- at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
- first receiving code configured to cause the at least one processor to receive a request for synthesizing speech, wherein the request for synthesizing speech comprises a target text document and a target language;
- first generating code configured to cause the at least one processor to generate phonetic transcriptions for the target text document;
- second generating code configured to cause the at least one processor to generate prosodic annotations for the target text document based on the target text document and the target language;
- third generating code configured to cause the at least one processor to generate phone durations and acoustic features based on the phonetic transcriptions and the prosodic annotations using a neural network;
- and
- first synthesizing code configured to cause the at least one processor to synthesize a speech corresponding to the target text document in the target language based on the generated phone durations and acoustic features.
A non-transitory computer-readable medium storing instructions, the instructions comprising:
- one or more instructions that, when executed by one or more processors of a device for synthesizing cross-lingual speech, cause the one or more processors to at least:
- receive a request for synthesizing speech, wherein the request for synthesizing speech comprises a target text document and a target language;
- generate phonetic transcriptions for the target text document;
- generate prosodic annotations for the target text document based on the target text document and the target language;
- generate phone durations and acoustic features based on the phonetic transcriptions and the prosodic annotations using a neural network;
- and
- synthesize a speech corresponding to the target text document in the target language based on the generated phone durations and acoustic features.
Dependencies are inferred from the claim text.