Method and system for producing synthesized speech digital audio content

A method for producing synthesized speech digital audio content, comprising steps wherein:

• a feature extractor module receives as input an audio recording of a speaker's voice, extracts a plurality of acoustic features from said audio recording, and converts said acoustic features to an audio latent representation matrix;
• a phonemizing module of a text preprocessing module receives as input a target text and converts said target text to a sequence of phonemes;
• a tokenizing module of said text preprocessing module receives as input said sequence of phonemes of said target text and converts said sequence of phonemes to a sequence of respective vectors of the phonemes of said target text, wherein each vector comprises a plurality of IDs that define a plurality of respective linguistic features of the phoneme of said target text;
• a linguistic encoder module receives as input said sequence of phoneme vectors of said target text and converts said sequence of phoneme vectors to a sequence of respective linguistic latent vectors, wherein each vector represents a set of independent latent spaces;
• an emotion predictor module of a speech emotion and emission recognition module receives as input said audio latent representation matrix, predicts an emotional state of the speech of a synthesized virtual voice, and produces as output a plurality of emotion signals in the time domain;
• an emission predictor module of said speech emotion and emission recognition module receives as input said audio latent representation matrix, predicts an emission intensity of the speech of said synthesized virtual voice, and produces as output a plurality of emission signals in the time domain;
• an acoustic model module receives as input said sequence of linguistic latent vectors and said plurality of emotion and emission signals in the time domain, predicts a latent representation of an audio signal of the speech of said synthesized virtual voice, and produces as output a predicted audio latent representation matrix;
• and
• a vocoder module receives as input said predicted audio latent representation matrix and decodes said predicted audio latent representation matrix into said audio signal of the speech of said synthesized virtual voice.