Systems and methods for generating dynamic conversational responses using deep conditional learning
AssigneeCapital One Services, LLC
InventorsMinh Le, Rui Zhang, Jonathan Gross
Life of this patent
Estimating the term…
Abstract
Methods and systems are described herein for generating dynamic conversational responses. Conversational responses include communications between a user and a system that may maintain a conversational tone, cadence, or speech pattern similar to a human during an interactive exchange between the user and the system. The interactive exchange may include the system responding to one or more user actions (which may include user inactions), and/or predicting responses prior to receiving a user action
Claims20
A method for generating dynamic conversational responses using conditional deep learning, the method comprising:
- receiving user data in response to a user interacting with a user interface;
- generating a feature input based on the user data;
- inputting the feature input into a first neural network, wherein the first neural network is trained based on a first training regime and a second training regime, wherein the first training regime comprises training an initial version of the first neural network based on a first data set, wherein the second training regime comprises further training the initial version based on a second data set and using a second neural network as a constraint, wherein parameters of the second neural network remain unchanged during the second training regime, and wherein the second neural network is trained based on a third data set;
- receiving an output from the first neural network;
- and
- generating for display, on the user interface, a first dynamic conversational response based on the output, wherein the first dynamic conversational response corresponds to a first probable intent of the user.
One or more non-transitory, computer-readable media for generating dynamic conversational responses using conditional deep learning, comprising instructions that, when executed on one or more processors, cause operations comprising:
- receiving user data in response to a user interacting with a user interface;
- generating a feature input based on the user data;
- inputting the feature input into a first neural network, wherein the first neural network is trained based on a first training regime and a second training regime, wherein the first training regime comprises training an initial version of the first neural network based on a first data set and using knowledge distillation to mimic predictions made by a first model by minimizing a loss function in which a target is a distribution of class probabilities predicted by the first model;
- receiving an output from the first neural network;
- and
- generating for display, on the user interface, a first dynamic conversational response based on the output, wherein the first dynamic conversational response corresponds to a first probable intent of the user.
The one or more non-transitory, computer-readable media of 13, wherein the instructions further cause operations comprising:
- generating for display, on the user interface, simultaneously with the first dynamic conversational response, a second dynamic conversational response;
- receiving a user selection of the first dynamic conversational response;
- and
- in response to the user selection, updating a multivariate distribution of probable intents of the user to reflect a probability of the user having a second probable intent, of the probable intents, based on the feature input, is zero.
Dependencies are inferred from the claim text.