US 11,769,482 B2 · Method and apparatus of synthesizing speech, method and apparatus of training speech synthesis model, electronic device, and storage medium

Abstract

The present disclosure provides a method and apparatus of synthesizing a speech, a method and apparatus of training a speech synthesis model, an electronic device, and a storage medium. The method of synthesizing a speech includes acquiring a style information of a speech to be synthesized, a tone information of the speech to be synthesized, and a content information of a text to be processed; generating an acoustic feature information of the text to be processed, by using a pre-trained speech synthesis model, based on the style information, the tone information, and the content information of the text to be processed; and synthesizing the speech for the text to be processed, based on the acoustic feature information of the text to be processed.

Claims10

Dependent claims

A method of synthesizing a speech, comprising:

acquiring a style information of a speech to be synthesized, a tone information of the speech to be synthesized, and a content information of a text to be processed;
generating an acoustic feature information of the text to be processed, by using a pre-trained speech synthesis model, based on the style information, the tone information, and the content information of the text to be processed;
and
synthesizing the speech for the text to be processed, based on the acoustic feature information of the text to be processed,
wherein the acquiring the style information of the speech to be synthesized comprises:
acquiring a description information of an input style of a user;
and determining a style identifier, from a preset style table, corresponding to the input style according to the description information of the input style, as the style information of the speech to be synthesized.

4 more elements

A method of training a speech synthesis model, comprising:

acquiring a plurality of training data, wherein each of the plurality of training data contains a training style information of a speech to be synthesized, a training tone information of the speech to be synthesized, a content information of a training text, a style feature information using a training style corresponding to the training style information to describe the content information of the training text, and a target acoustic feature information using the training style corresponding to the training style information and a training tone corresponding to the training tone information to describe the content information of the training text;
and
training the speech synthesis model by using the plurality of training data.

Dependencies are inferred from the claim text.

Method and apparatus of synthesizing speech, method and apparatus of training speech synthesis model, electronic device, and storage medium

Life of this patent

Method and apparatus of synthesizing speech, method and apparatus of training speech synthesis model, electronic device, and storage medium

Life of this patent

Abstract

Claims10