Back to results
US 12,762,469 B1Granted
Unsupervised neural stylistic text generation
AssigneeAmazon Technologies, Inc.
InventorsVinayshekhar Bannihatti Kumar, Rashmi Gangadharaiah, Dan Roth
Life of this patent
Estimating the term…
Abstract
Techniques for training a stylistic response generator and/or using a stylistic response generator are described. In some examples, the stylistic response generator is trained by receiving a request to train a stylistic response generator, the request to include an indication of a plurality of styles to use to train the stylistic response generator and then training the stylistic response generator to generate responses according to the plurality of styles.
Claims20
A computer-implemented method comprising:
- receiving a request to train a stylistic response generator;
- training the stylistic response generator by:
- training an encoder and multiple decoders of the stylistic response generator to learn to predict responses, the multiple decoders of the stylistic response generator having different adapter weights,
- training the different adapter weights of the decoders of the stylistic response generator to learn stylistic properties based on a language model objective, and
- training the decoders using the different adapter weights and the encoder of the stylistic response generator to learn to predict responses;
- and
- using the trained stylistic response generator to generate a stylistic response in response to a query by:
- receiving, by the trained stylistic response generator, context information;
- encoding, by the encoder of the stylistic response generator, the context information to generate encoded context;
- providing the encoded context to a decoder selector of the stylistic response generator;
- determining, by the decoder selector, which of the decoders to use to predict the stylistic response based on a style;
- and
- sending the encoded context to a selected one of the decoders.
10 more elements
A computer-implemented method comprising:
- receiving a request to train a stylistic response generator, the request including an indication of a plurality of styles to use to train the stylistic response generator;
- training an encoder and a decoder of the stylistic response generator to generate responses according to the plurality of styles, the decoder of the stylistic response generator having different adapter weights;
- and
- using the trained stylistic response generator to generate a stylistic response in response to a query by:
- receiving, by the trained stylistic response generator, context information;
- encoding, by the encoder of the stylistic response generator, the context information to generate encoded context;
- providing the encoded context to an adapter weight selector of the stylistic response generator;
- determining, by the adapter weight selector, which of the different adapter weights to use to predict the stylistic response based on a style;
- and
- sending the encoded context to selected ones of the different adapter weights.
7 more elements
A system comprising:
- a first one or more electronic devices implementing a chatbot service in a multi-tenant provider network;
- and
- a second one or more electronic devices implementing a stylistic response generator service in the multi-tenant provider network, the stylistic response generator service implemented as code stored in memory that upon execution by one or more processors of the stylistic response generator service cause the stylistic response generator service to:
- receive a request to train a stylistic response generator, the request including an indication of a plurality of styles to use to train the stylistic response generator;
- and
- train an encoder and a decoder of the stylistic response generator to generate responses according to the plurality of styles, the decoder of the stylistic response generator having different adapter weights;
- and
- use the trained stylistic response generator to generate a stylistic response for a chat session of the chatbot service by:
- receiving, by the trained stylistic response generator, context information;
- encoding, by the encoder of the stylistic response generator, the context information to generate encoded context;
- providing the encoded context to an adapter weight selector of the stylistic response generator;
- determining, by the adapter weight selector, which of the different adapter weights to use to predict the stylistic response based on a style;
- and
- sending the encoded context to selected ones of the different adapter weights.
11 more elements
Dependencies are inferred from the claim text.