Multi-level emotional enhancement of dialogue

A method for use by a system including a computing platform having a speech synthesizer, a processing hardware and a system memory storing a software code, the software code including at least one of a trained machine learning (ML) model configured to function as an autoregressive generator or a stochastic model trained using unsupervised or semi-supervised learning:

• receiving, by the software code executed by the processing hardware, dialogue data identifying an utterance for use by a digital character in a conversation;
• analyzing, by the software code executed by the processing hardware and using the dialogue data, an emotionality of the utterance at a plurality of structural levels of the utterance;
• supplementing the utterance with one or more emotional attributions, by the software code executed by the processing hardware and using the at least one of the trained ML model or the stochastic model and the emotionality of the utterance at the plurality of structural levels, to provide a plurality of candidate emotionally enhanced utterances;
• performing, by the software code executed by the processing hardware, an audio validation of at least some of the plurality of candidate emotionally enhanced utterances to provide a validated emotionally enhanced utterance including a non-verbal vocalization, wherein the audio validation identifies the validated emotionally enhanced utterance as having a best audio quality of the at least some of the plurality of candidate emotionally enhanced utterances;
• outputting, by the software code executed by the processing hardware, an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation;
• and
• synthesizing, by the software code executed by the processing hardware using the speech synthesizer and the emotionally attributed dialogue data, the validated emotionally enhanced utterance to generate a synthesized speech for utterance by the digital character.