Speech Synthesis Method and Systems
AssigneeTencent Technology (Shenzhen) Company Limited
InventorsShilun Lin, Li Meng, Wenchao Su
Life of this patent
Estimating the term…
Abstract
Speech synthesis techniques are described herein, which relate to the field of artificial intelligence (AI). The techniques may include performing feature extraction on prompt audio to obtain a prompt semantic token and a prompt acoustic token; performing feature extraction on input text to obtain an input semantic token; acquiring an input acoustic token based on the prompt semantic token, the prompt acoustic token, and the input semantic token; and generating an output audio of the input text based on the input acoustic token. According to this application accuracy of speech synthesis can be improved.
Claims20
A computer-implemented speech synthesis method comprising:
- performing feature extraction on a prompt audio to obtain a prompt semantic token and a prompt acoustic token, the prompt semantic token being configured for indicating semantic features of the prompt audio at respective time points, and the prompt acoustic token being configured for indicating acoustic features of the prompt audio at the time points;
- performing feature extraction on an input text to obtain an input semantic token, the input semantic token being configured for indicating semantic features of a speech corresponding to the input text at the time points;
- generating an input acoustic token based on the prompt semantic token, the prompt acoustic token, and the input semantic token;
- the input acoustic token being configured for indicating acoustic features of the speech corresponding to the input text at the time points;
- and
- generating an output audio of the input text based on the input acoustic token.
One or more non-transitory computer readable media comprising computer readable instructions that, when executed by a processor, configure a data processing system to perform:
- performing feature extraction on a prompt audio to obtain a prompt semantic token and a prompt acoustic token, the prompt semantic token being configured for indicating semantic features of the prompt audio at respective time points, and the prompt acoustic token being configured for indicating acoustic features of the prompt audio at the time points;
- performing feature extraction on an input text to obtain an input semantic token, the input semantic token being configured for indicating semantic features of a speech corresponding to the input text at the time points;
- generating an input acoustic token based on the prompt semantic token, the prompt acoustic token, and the input semantic token;
- the input acoustic token being configured for indicating acoustic features of the speech corresponding to the input text at the time points;
- and
- generating an output audio of the input text based on the input acoustic token.
A system comprising:
- a processor, and memory storing computer readable instructions that, when executed by the processor, configure the system to perform:
- performing feature extraction on a prompt audio to obtain a prompt semantic token and a prompt acoustic token, the prompt semantic token being configured for indicating semantic features of the prompt audio at respective time points, and the prompt acoustic token being configured for indicating acoustic features of the prompt audio at the time points;
- performing feature extraction on an input text to obtain an input semantic token, the input semantic token being configured for indicating semantic features of a speech corresponding to the input text at the time points;
- generating an input acoustic token based on the prompt semantic token, the prompt acoustic token, and the input semantic token;
- the input acoustic token being configured for indicating acoustic features of the speech corresponding to the input text at the time points;
- and
- generating an output audio of the input text based on the input acoustic token.
Dependencies are inferred from the claim text.