Intent recognition and emotional text-to-speech learning

A computer readable media not consisting of a propagated data signal, the computer readable media storing executable instructions that, when executed by a computer, cause the computer to perform operations comprising:

• receiving a speech input comprising spoken words;
• generating a text result based on the speech input, wherein the text result comprises a textual representation of the spoken words in the speech input;
• generating acoustic feature annotations based on the speech input, the acoustic feature annotations including at least spectral harmonics of the speech input;
• determining an emotion associated with the speech input;
• and
• applying an intent model to the text result and the acoustic feature annotations to recognize an intent based on the speech input, wherein, when the emotion is determined to be sarcasm, the recognized intent is to perform no action with respect to a device.

A device comprising:

• a processing unit;
• and
• a memory storing computer executable instructions that, when executed by the processing unit, causes the device to perform operations, comprising:
• receiving a speech input comprising spoken words;
• generating a text result based on the speech input, wherein the text result comprises a textual representation of the spoken words in the speech input;
• generating acoustic feature annotations based on the speech input, the acoustic feature annotations including at least spectral harmonics of the speech input;
• determining an emotion associated with the speech input;
• and
• applying an intent model to the text result and the acoustic feature annotations to recognize an intent based on the speech input, wherein, when the emotion is determined to be sarcasm, the recognized intent is to perform no action with respect to a device.