Iterative attention-based neural network training and processing
AssigneeSteven D. Flinn
InventorsSteven Dennis Flinn, Naomi Felina Moneypenny
Life of this patent
Estimating the term…
Abstract
An iterative attention-based neural network training and processing method and system iteratively applies a focus of attention of a trained neural network on syntactical elements and generates probabilities associated with representations of the syntactical elements, which in turn inform a subsequent focus of attention of the neural network, resulting in updated probabilities. The updated probabilities are then applied to generate syntactical elements for delivery to a user. The user may respond to the delivered syntactical elements, providing additional training information to the trained neural network.
Claims84
A computer-implemented method, comprising:
- at a system including one or more processors, and one or more memories in communication with the one or more processors and with one or more programs stored therein:
- causing access to a trained computer-implemented neural network;
- based on a prompt, causing generation, by utilizing the trained computer-implemented neural network and by applying a first plurality of attentions, a first plurality of syntactical elements;
- causing evaluation of the first plurality of syntactical elements;
- causing selection of first syntactical elements from the first plurality of syntactical elements, based on the evaluation of the first plurality of syntactical elements;
- based on the first syntactical elements, causing generation, by utilizing the trained computer-implemented neural network and by applying a second plurality of attentions, a second plurality of syntactical elements;
- causing evaluation of the second plurality of syntactical elements;
- causing selection of second syntactical elements from the second plurality of syntactical elements, based on the evaluation of the second plurality of syntactical elements;
- causing an association between the first syntactical elements and the second syntactical elements;
- and
- causing a communication to be sent, based on the association between the first syntactical elements and the second syntactical elements.
Dependencies are inferred from the claim text.