Systems and methods for generating synthesized speech responses to voice inputs by training a neural network model based on the voice input prosodic metrics and training voice inputs

A system for providing a synthesized speech response to a voice input with a neural network model trained by:

• receiving a plurality of training voice inputs, each associated with at least one respective voice input prosodic metric;
• extracting training data from the plurality of training voice inputs and the associated voice input prosodic metrics;
• processing the extracted training data for input into the neural network model;
• receiving a plurality of responses, each associated with at least one respective response prosodic metric;
• training the neural network model based on the extracted training data including the processed plurality of training voice inputs, the plurality of responses, the associated and processed voice input prosodic metrics, and the associated response prosodic metrics;
• and
• outputting, with the trained neural network model, information used to generate the synthesized speech response to the voice input, the system comprising:
• control circuitry for:
• receiving the voice input;
• calculating at least one prosodic metric of the voice input;
• determining a response to the voice input;
• and
• generating the synthesized speech response based on the calculated at least one prosodic metric of the voice input and the information outputted from the trained neural network model;
• and
• an output device for outputting the synthesized speech response.